-- Logs begin at Thu 2021-10-28 11:49:12 UTC, end at Thu 2021-10-28 12:51:06 UTC. -- Oct 28 12:22:05.418252 dv-cinder-815146-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 28 12:22:05.427487 dv-cinder-815146-6-iscsi devstack@n-api.service[100729]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 28 12:22:05.429622 dv-cinder-815146-6-iscsi devstack@n-api.service[100729]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 28 12:22:05 2021] *** Oct 28 12:22:05.429622 dv-cinder-815146-6-iscsi devstack@n-api.service[100729]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 12:22:05.429622 dv-cinder-815146-6-iscsi devstack@n-api.service[100729]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 12:22:05.429622 dv-cinder-815146-6-iscsi devstack@n-api.service[100729]: nodename: dv-cinder-815146-6-iscsi Oct 28 12:22:05.429622 dv-cinder-815146-6-iscsi devstack@n-api.service[100729]: machine: x86_64 Oct 28 12:22:05.429622 dv-cinder-815146-6-iscsi devstack@n-api.service[100729]: clock source: unix Oct 28 12:22:05.429622 dv-cinder-815146-6-iscsi devstack@n-api.service[100729]: pcre jit disabled Oct 28 12:22:05.429622 dv-cinder-815146-6-iscsi devstack@n-api.service[100729]: detected number of CPU cores: 4 Oct 28 12:22:05.429622 dv-cinder-815146-6-iscsi devstack@n-api.service[100729]: current working directory: / Oct 28 12:22:05.429622 dv-cinder-815146-6-iscsi devstack@n-api.service[100729]: detected binary path: /usr/bin/uwsgi-core Oct 28 12:22:05.429622 dv-cinder-815146-6-iscsi devstack@n-api.service[100729]: your processes number limit is 47680 Oct 28 12:22:05.429622 dv-cinder-815146-6-iscsi devstack@n-api.service[100729]: your memory page size is 4096 bytes Oct 28 12:22:05.429622 dv-cinder-815146-6-iscsi devstack@n-api.service[100729]: detected max file descriptor number: 2048 Oct 28 12:22:05.429622 dv-cinder-815146-6-iscsi devstack@n-api.service[100729]: lock engine: pthread robust mutexes Oct 28 12:22:05.430500 dv-cinder-815146-6-iscsi devstack@n-api.service[100729]: thunder lock: enabled Oct 28 12:22:05.430500 dv-cinder-815146-6-iscsi devstack@n-api.service[100729]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 28 12:22:05.430500 dv-cinder-815146-6-iscsi devstack@n-api.service[100729]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 28 12:22:05.473903 dv-cinder-815146-6-iscsi devstack@n-api.service[100729]: Python main interpreter initialized at 0x5581117619c0 Oct 28 12:22:05.473903 dv-cinder-815146-6-iscsi devstack@n-api.service[100729]: python threads support enabled Oct 28 12:22:05.473903 dv-cinder-815146-6-iscsi devstack@n-api.service[100729]: your server socket listen backlog is limited to 100 connections Oct 28 12:22:05.473903 dv-cinder-815146-6-iscsi devstack@n-api.service[100729]: your mercy for graceful operations on workers is 90 seconds Oct 28 12:22:05.474283 dv-cinder-815146-6-iscsi devstack@n-api.service[100729]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 12:22:05.474283 dv-cinder-815146-6-iscsi devstack@n-api.service[100729]: *** Operational MODE: preforking *** Oct 28 12:22:05.474578 dv-cinder-815146-6-iscsi devstack@n-api.service[100729]: *** uWSGI is running in multiple interpreter mode *** Oct 28 12:22:05.474578 dv-cinder-815146-6-iscsi devstack@n-api.service[100729]: spawned uWSGI master process (pid: 100729) Oct 28 12:22:05.474790 dv-cinder-815146-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 28 12:22:05.479699 dv-cinder-815146-6-iscsi devstack@n-api.service[100729]: spawned uWSGI worker 1 (pid: 100730, cores: 1) Oct 28 12:22:05.479699 dv-cinder-815146-6-iscsi devstack@n-api.service[100729]: spawned uWSGI worker 2 (pid: 100731, cores: 1) Oct 28 12:22:05.479699 dv-cinder-815146-6-iscsi devstack@n-api.service[100729]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 12:22:07.105003 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 12:22:07.105003 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: from cryptography.utils import int_from_bytes Oct 28 12:22:07.105744 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 12:22:07.105744 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: from cryptography.utils import int_from_bytes Oct 28 12:22:07.105865 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 12:22:07.105865 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: from cryptography.utils import int_from_bytes Oct 28 12:22:07.106276 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 12:22:07.106276 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: from cryptography.utils import int_from_bytes Oct 28 12:22:09.702096 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 12:22:09.702793 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 12:22:09.703120 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 12:22:09.703209 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 12:22:09.703287 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 12:22:09.703354 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 12:22:09.703424 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 12:22:09.703497 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 12:22:09.703568 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 12:22:09.703642 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 12:22:09.703778 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.703912 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.704065 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.704167 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.704418 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.704569 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.704698 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.704829 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.705080 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.705213 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.705436 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.705581 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.705676 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.705749 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.706010 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.706160 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.706333 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.706459 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.706569 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.706645 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.706852 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.706964 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.707204 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815146-6-iscsi {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.707344 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815146-6-iscsi {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.707486 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.707581 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.707818 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.707954 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.708096 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.708189 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.708427 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.708548 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.708694 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.708808 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.709072 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.709245 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.709392 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.709523 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.709864 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.711269 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.711269 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.711522 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.711642 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.711771 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.711771 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.711996 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.712121 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.712240 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.712359 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.712490 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.712618 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.712785 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.712923 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.713045 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.713171 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.713340 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.713507 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.713633 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.713735 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.713847 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.713958 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815146-6-iscsi {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.714077 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815146-6-iscsi {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.714214 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.714345 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.714466 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.714584 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.714709 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.714828 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.714958 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.715109 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.715227 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.715360 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.715512 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.715640 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.715750 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.715881 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.716014 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.716142 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.716272 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.716399 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.716519 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.716638 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.716779 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.716923 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.717120 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.717241 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.717438 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.717624 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.717767 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.717977 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.718110 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.718240 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.718368 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.718489 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.718616 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.718747 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.718868 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.718993 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.719193 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.719379 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.719519 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.719660 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.719783 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.719903 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.720023 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.720142 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.720310 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.720450 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.720652 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.720881 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.720881 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.721129 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.721129 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.721377 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.721505 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.721632 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.721759 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.721890 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.722036 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.722171 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.722369 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.722554 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.722693 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.722835 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.722959 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.723079 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.723211 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.723339 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.723547 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.723726 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.723855 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.723975 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.724106 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.724234 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.724440 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.724618 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.724816 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.724944 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.725179 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.725303 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.725435 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.725561 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.725680 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.725799 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.726106 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.726290 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.726425 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.726549 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.726672 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.726790 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.726916 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.727036 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.727266 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.727503 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.727628 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.727759 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.727890 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.728018 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.728140 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.728299 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.728445 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.728576 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.728757 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.728938 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.729119 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.729253 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.729381 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.729500 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.729720 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.729917 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.730052 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.730175 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.730297 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.730417 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.730537 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.730663 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.730795 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.730917 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.731124 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.731310 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.731456 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.731581 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.731701 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.731820 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.732013 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.732199 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.732346 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.732471 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.732598 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.732759 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.732883 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.733017 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.733193 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.733324 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.733514 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.733689 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.733823 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.733949 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.734083 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.734206 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.734360 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.734494 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.734692 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.734867 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.735016 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.735141 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.735263 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.735391 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.735575 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.735717 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.735869 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.736002 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.736179 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.736306 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.736483 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.736618 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.736799 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.736924 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.737115 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.737253 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.737466 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.737598 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.737729 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.737857 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.737985 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.738112 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.738298 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.738443 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.738571 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.738690 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.738897 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.739028 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.739204 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.739347 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.739499 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.739623 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.739820 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.739954 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.740105 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.740242 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.740421 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.740546 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.740758 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.740898 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.741079 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.741213 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.741391 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.741516 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.741686 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.741809 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.741976 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.742111 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.742264 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.742393 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.742571 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.742703 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.742863 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.742996 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.743170 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.743304 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.743456 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.743588 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.743789 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.743919 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.744049 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.744169 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.744361 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.744509 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.744677 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.744870 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.745004 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.745150 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.745286 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.745397 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:22:09.745598 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.745713 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.745925 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.746039 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.746262 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.746397 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.746577 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.746714 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.746905 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.747030 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.747233 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.747371 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.747572 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.747696 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.747863 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.748014 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.748144 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.748271 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.748467 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.748594 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.748797 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.748935 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.749108 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.749241 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.749416 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.749547 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.749731 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.749856 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.750044 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.750168 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.750368 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.750522 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.750658 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.750781 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.750980 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.751108 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.751296 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.751431 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.751609 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.751743 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.751928 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.752062 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.752240 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.752365 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.752556 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.752786 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.752926 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.753049 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.753218 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.753346 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.753554 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.753679 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.753862 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.753989 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.754182 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.754314 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.754492 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.754625 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.754803 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.754930 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.755111 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.755237 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.755422 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.755559 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.755729 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.755864 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.756053 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.756178 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.756410 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.756552 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.756706 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.756878 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.757069 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.757196 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.757383 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.757523 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.757728 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.757853 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.757973 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.758092 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.758278 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.758413 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.758588 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.758713 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.758895 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.759019 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.759192 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.759355 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.759477 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.759602 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.759809 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.759942 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.760105 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.760255 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.760439 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.760581 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.760764 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.760894 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.761081 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.761198 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.761388 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.761513 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.761676 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.761810 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.761996 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.762121 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.762302 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.762426 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.762602 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.762745 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.762919 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.763044 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.763224 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.763356 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.763528 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.763665 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.763845 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.763970 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.764130 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.764250 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.764430 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.764566 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.764806 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.764933 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.765053 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.765173 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.765361 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.765487 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.765671 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.765799 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.765987 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.766116 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.766327 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.766466 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.766588 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.766717 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.766906 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.767029 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.767236 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.767366 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.767538 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.767660 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.767855 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.767978 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.768172 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.768295 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.768489 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.768619 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.768819 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.768956 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.769135 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.769256 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.769436 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.769738 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.769861 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.770039 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.770171 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.770410 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.770540 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.770717 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.770855 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.770986 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.771114 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.771235 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.771354 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.771503 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.771633 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.771822 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.771954 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.772203 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.772332 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.772530 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.772691 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.772849 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.772970 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.773145 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.773274 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.773448 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.773580 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.773754 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.773876 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.774097 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.774236 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.774406 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.774579 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.774750 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.775068 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.775191 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.775395 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.775567 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.775717 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.776219 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.776359 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.776465 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.776637 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.776834 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.776984 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.777145 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.777271 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.777563 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.777686 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.777891 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.778107 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.778213 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.778509 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.778597 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.778820 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.779136 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.779227 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.779450 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.779724 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.779812 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.780066 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.780243 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.780384 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.780738 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.780840 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.781077 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.781246 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.781396 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.781708 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.781795 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.782039 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.782199 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.782377 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.782517 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.782696 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.782832 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.783029 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.783174 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.783376 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.783512 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.783715 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.783850 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.784040 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.784180 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.784349 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.784482 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.784670 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.784821 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.785013 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.785147 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.785329 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.785463 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.785640 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.785771 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.785952 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.786095 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.786254 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.786392 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.786569 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.786715 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.786879 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.787010 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.787200 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.787324 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.787560 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.787690 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.787879 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.788019 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.788215 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.788346 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.788499 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.788622 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.788821 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.788959 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.789130 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.789261 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.789436 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.789567 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.789742 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.789874 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.790054 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.790184 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.790370 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.790495 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.790682 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.790806 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.790991 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.791114 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.791296 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.791452 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.791625 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.791749 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.791897 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.792029 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.792200 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.792329 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.792504 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.792637 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.792839 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.792965 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.793149 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.793270 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.793459 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.793584 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.793764 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.793887 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.794078 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.794209 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.794383 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.794505 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.794686 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.794810 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.794991 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.795126 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.795303 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.795425 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.795610 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.795733 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.795918 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.796050 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.796223 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.796355 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.796543 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.796666 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.796872 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.797082 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.797205 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.797324 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.797484 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.797608 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.797795 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.797921 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.798105 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.798241 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.798441 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.798572 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.798700 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.798828 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.799033 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.799157 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.799346 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.799469 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.799654 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.799779 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.799967 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.800098 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.800279 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.800411 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.800585 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.800708 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.800921 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.801042 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.801229 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.801363 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.801540 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.801662 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.801848 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.801969 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.802161 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.802291 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.802469 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.802591 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.802775 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.802891 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.803107 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.803237 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.803427 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.803550 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.803733 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.804004 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.804147 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.804339 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.804463 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.804645 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.804802 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.804983 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.805115 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.805289 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.805411 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.805597 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.805723 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.805912 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.806043 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.806243 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.806476 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.806606 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.806808 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.806924 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.807110 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.807281 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.807432 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.807561 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.807733 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.807886 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.808080 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.808205 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.808326 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.808460 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.808647 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.808806 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.808932 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.809051 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.809234 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.809357 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.809544 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.809676 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.809851 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.809982 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.810169 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.810291 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.810839 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.810976 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.811147 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.811285 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.811448 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.811573 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.811750 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.811873 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.812053 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.812175 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.812353 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.812476 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.812658 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.812841 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.812974 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.813094 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.813283 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.813402 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.813588 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.813723 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.813896 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.814026 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.814207 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.814338 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.814510 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.814633 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.814831 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.814964 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.815139 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.815263 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.815443 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.815574 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.815747 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.815874 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.816049 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.816172 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.816370 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.816498 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.816682 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.816825 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.817011 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.817134 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.817322 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.817445 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.817631 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.817756 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.817936 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.818059 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.818249 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.818372 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.818563 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.818835 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.818965 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.819083 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.819202 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.819331 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.819500 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.819631 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.819806 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.819930 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.820110 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.820244 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.820411 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.820544 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.820751 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.820889 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.821050 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.821259 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.821383 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.821501 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.821649 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.821773 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.821951 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.822085 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.822253 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.822375 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.822554 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.822725 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.822893 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.823016 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.823158 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.823290 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.823457 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.823578 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.823757 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.823889 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.824060 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.824185 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.824363 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.824485 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.824663 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.824807 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.824991 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.825112 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.825291 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.825424 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.825605 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.825738 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.825908 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.826030 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.826208 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.826339 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.826509 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.826640 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.826812 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.826934 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.827117 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.827246 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.827418 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.827542 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.827739 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.827860 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.828051 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.828180 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.828397 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.828532 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.828653 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.828793 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.828980 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.829117 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.829247 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.829369 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.829548 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.829678 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.829856 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.829981 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.830178 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.830309 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.830494 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.830618 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.830798 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.830923 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.831106 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.831230 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.831411 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.831536 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.831713 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.831846 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.832013 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.832137 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.832317 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.832438 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.832615 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.832792 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.832940 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.833063 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.833244 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.833389 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.833549 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.833674 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.833849 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.833972 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.834167 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.834321 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.834503 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.834661 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.834791 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.834897 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.835087 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.835219 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.835387 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.835511 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.835727 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.835859 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.836031 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.836163 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.836343 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.836465 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.836661 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.836819 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.837000 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.837124 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.837305 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.837428 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.837609 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.837732 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.837923 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.838046 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.838240 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.838406 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.838540 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.838659 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.838836 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.838974 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.839159 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.839283 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.839444 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.839569 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.839747 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.839873 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.840050 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.840173 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.840359 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.840480 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.840667 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.840822 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.841002 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.841126 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.841313 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.841480 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.841624 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.841747 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.841936 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.842060 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.842235 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.842370 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.842542 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.842667 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.842849 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.842979 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.843153 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.843284 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.843457 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.843579 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.843761 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.843882 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.844066 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.844199 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.844373 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.844495 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.844680 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.844850 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.845010 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.845135 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.845316 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.845446 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.845619 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.845750 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.845924 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.846056 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.846227 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.846349 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.846525 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.846667 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.846846 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.846971 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.847151 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.847275 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.847451 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.847575 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.847762 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.847893 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.848064 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.848187 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.848372 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.848503 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.848676 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.848816 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.849098 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.849295 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.849420 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.849622 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.849752 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.849872 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.850031 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.850182 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.850371 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.850508 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.850686 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.850817 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.851003 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.851126 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.851315 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.851452 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.851620 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.851743 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.851944 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.852074 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.852253 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.852378 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.852557 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.852790 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.852915 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.853035 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.853201 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.853327 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.853520 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.853643 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.853834 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.854006 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.854161 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.854284 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.854441 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.854565 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.854741 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.854919 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.855055 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.855230 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.855361 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.855545 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.855668 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.855868 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.855992 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.856193 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.856339 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.856523 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.856647 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.856852 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.856979 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.857164 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.857371 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.857495 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.857684 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.857817 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.857991 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.858114 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.858310 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.858433 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.858629 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.858760 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.858949 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.859073 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.859251 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.859459 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.859593 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.859720 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.859841 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.859968 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.860160 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.860283 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.860479 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.860604 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.860840 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.860965 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.861115 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.861249 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.861418 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.861543 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.861739 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.861865 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.862059 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.862210 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.862371 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.862500 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.862694 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.862819 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.863031 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.863153 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.863336 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.863473 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.863662 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.863792 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.863972 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.864096 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.864286 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.864418 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.864589 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.864738 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.864915 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.865050 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.865222 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.865355 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.865523 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.865666 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.865847 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.865973 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.866166 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.866299 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.866465 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.866587 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.866772 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.866902 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.867083 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.867216 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.867388 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.867511 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.867693 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.867817 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.867994 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.868121 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.868312 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.868445 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.868611 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.868763 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.868940 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.869064 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.869248 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.869371 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.869610 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.869767 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.869900 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.870023 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.870142 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.870264 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.870456 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.870581 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.870761 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.870886 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.871062 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.871186 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.871363 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.871494 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.871665 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.871796 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.872002 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.872127 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.872304 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.872443 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.872620 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.872806 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.872973 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.873109 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.873277 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.873413 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.873589 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.873712 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.873897 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.874023 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.874203 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.874334 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.874507 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.874639 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.874816 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.874940 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.875121 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.875246 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.875419 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.875548 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.875720 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.875844 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.876027 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.876152 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.876328 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.876465 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.876628 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.876769 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.876953 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.877085 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.877258 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.877388 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.877558 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.877692 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.877861 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.877983 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.878161 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.878284 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.878481 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.878614 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.878781 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.878912 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.879101 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.879226 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.879405 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.879537 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.879737 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.879861 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.879990 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.880120 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.880280 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.880450 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.880617 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.880759 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.880947 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.881082 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.881299 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.881458 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.881642 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.881765 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.881960 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.882081 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.882277 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.882402 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.882580 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.882702 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.882888 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.883009 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.883204 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.883327 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.883519 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.883642 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.883832 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.883954 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.884146 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.884346 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.884471 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.884677 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.884823 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.885015 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.885186 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.885343 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.885470 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.885629 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.885753 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.885945 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.886071 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.886265 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.886396 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.886576 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.886779 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.886912 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.887106 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.887230 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.887418 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.887542 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.887735 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.887867 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.888046 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.888171 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.888358 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.888489 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.888655 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.888804 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.888992 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.889115 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.889299 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.889423 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.889607 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.889747 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.889932 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.890063 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.890221 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.890353 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.890541 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.890666 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.890864 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.890988 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.891190 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.891320 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.891499 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.891628 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.891810 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.891938 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.892119 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.892249 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.892426 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.892548 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.892757 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.892883 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.893072 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.893197 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.893383 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.893505 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.893690 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.893820 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.894000 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.894122 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.894310 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.894432 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.894618 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.894753 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.894925 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.895050 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.895234 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.895357 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.895542 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.895742 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.895865 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.895984 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.896141 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.896264 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.896451 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.896659 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.896801 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.897024 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.897152 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.897361 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.897484 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.897688 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.897807 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.898012 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.898142 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.898331 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.898463 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.898642 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.898765 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.898963 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.899158 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.899280 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.899469 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.899593 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.899802 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.899939 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.900130 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.900255 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.900438 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.900575 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.900813 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.900977 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.901107 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.901220 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.901372 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.901497 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.901679 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.901802 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.901981 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.902117 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.902290 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.902513 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.902637 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.902866 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.902998 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.903195 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.903326 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.903485 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.903607 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.903795 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.903920 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.904114 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.904238 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.904428 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.904556 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.904778 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.904975 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.905091 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.905322 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.905410 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.905643 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.905730 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.905968 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.906057 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.906291 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.906378 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.906596 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.906681 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.906903 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.906999 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.907212 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.907300 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.907517 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.907604 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.907824 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.907934 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.908133 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.908229 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.908437 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.908533 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.908757 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.908851 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.909067 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.909157 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.909378 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.909481 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.909682 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.909777 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.909987 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.910074 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.910292 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.910396 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.910595 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.910681 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.910900 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.910986 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.911218 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.911315 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.911521 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.911607 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.911828 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.911916 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.912133 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.912220 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.912436 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.912535 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.912811 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.912904 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.913120 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.913217 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.913423 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.913509 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.913732 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.913825 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.914037 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.914127 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.914344 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.914431 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.914643 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.914730 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.914955 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.915051 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.915257 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.915351 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.915566 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.915654 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.915868 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.915957 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.916187 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.916275 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.916491 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.916588 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.916825 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.917070 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.917218 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.917429 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.917523 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.917755 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.917853 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.918068 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.918155 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.918378 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.918467 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.918719 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.918813 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.919030 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.919123 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.919333 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.919557 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.919648 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.919940 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.920027 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.920251 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.920339 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.920563 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.920660 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.920915 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.921013 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.921230 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.921318 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.921533 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.921621 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.921838 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.921926 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.922145 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.922237 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.922456 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.922542 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.922764 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.922852 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.923072 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.923169 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.923384 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.923471 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.923692 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.923781 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.924112 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.924223 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.924373 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.924462 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.924682 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.924809 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.925048 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.925154 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.925387 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.925475 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.925704 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.925789 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.926019 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.926113 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.926334 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.926436 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.926644 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.926731 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.926951 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.927066 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.927263 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.927384 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.927576 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.927706 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.927886 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.928033 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.928253 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.928370 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.928617 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.928734 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.928964 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.929055 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.929274 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.929373 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.929659 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.929756 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.929976 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.930072 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.930309 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.930438 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.930650 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.930747 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.930960 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.931053 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.931284 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.931379 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.931593 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.931680 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.931905 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.931994 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.932215 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.932372 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.932582 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.932670 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.932863 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.932952 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.933179 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.933266 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.933505 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.933594 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.933820 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.933907 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.934123 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.934211 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.934431 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.934520 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.934801 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.934900 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.935045 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.935143 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.935365 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.935817 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.936036 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.936123 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.936360 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.936462 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.936671 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.936776 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.937011 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.937099 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.937322 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.937419 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.937633 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.937719 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.937944 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.938033 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.938253 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.938353 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.938560 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.938646 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.938890 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.938977 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.939196 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.939283 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.939504 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.939590 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.939816 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.939911 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.940126 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.940215 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.940435 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.940524 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.940766 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.940859 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.941092 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.941190 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.941403 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.941489 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.941708 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.941802 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.942018 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.942104 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.942333 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.942422 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.942648 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.942744 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.942963 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.943050 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.943275 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.943362 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.943602 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.943697 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.943965 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.944051 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.944284 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.944379 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.944596 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.944684 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.944934 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.945022 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.945253 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.945351 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.945569 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.945658 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.945896 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.945983 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 12:22:09.946223 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.946549 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.946877 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.947218 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.947536 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.947879 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.948205 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:22:09.948447 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 12:22:09.969230 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG oslo_db.sqlalchemy.engines [None req-842c203c-fa84-4b26-96bf-269a9b8805e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100730) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 12:22:09.971493 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG oslo_db.sqlalchemy.engines [None req-d8d7220c-786e-4e24-8ae6-1e37cc134b59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 12:22:10.146470 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.context [None req-842c203c-fa84-4b26-96bf-269a9b8805e8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b82f072f-c7c2-44f1-a3e5-64a44a75f91b(cell1) {{(pid=100730) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 12:22:10.146812 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.context [None req-d8d7220c-786e-4e24-8ae6-1e37cc134b59 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b82f072f-c7c2-44f1-a3e5-64a44a75f91b(cell1) {{(pid=100731) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 12:22:10.151271 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG oslo_concurrency.lockutils [None req-842c203c-fa84-4b26-96bf-269a9b8805e8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:10.151408 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG oslo_concurrency.lockutils [None req-d8d7220c-786e-4e24-8ae6-1e37cc134b59 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:10.152877 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG oslo_concurrency.lockutils [None req-d8d7220c-786e-4e24-8ae6-1e37cc134b59 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:10.153000 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG oslo_concurrency.lockutils [None req-842c203c-fa84-4b26-96bf-269a9b8805e8 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:10.153705 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG oslo_concurrency.lockutils [None req-d8d7220c-786e-4e24-8ae6-1e37cc134b59 None None] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:10.153842 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG oslo_concurrency.lockutils [None req-842c203c-fa84-4b26-96bf-269a9b8805e8 None None] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:10.155640 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG oslo_concurrency.lockutils [None req-d8d7220c-786e-4e24-8ae6-1e37cc134b59 None None] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:10.155774 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG oslo_concurrency.lockutils [None req-842c203c-fa84-4b26-96bf-269a9b8805e8 None None] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:10.168406 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG oslo_db.sqlalchemy.engines [None req-d8d7220c-786e-4e24-8ae6-1e37cc134b59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 12:22:10.169497 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG oslo_db.sqlalchemy.engines [None req-842c203c-fa84-4b26-96bf-269a9b8805e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100730) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 12:22:10.171714 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG oslo_db.sqlalchemy.engines [None req-842c203c-fa84-4b26-96bf-269a9b8805e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100730) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 12:22:10.176767 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG oslo_db.sqlalchemy.engines [None req-d8d7220c-786e-4e24-8ae6-1e37cc134b59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 12:22:10.432304 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG oslo_db.sqlalchemy.engines [None req-d8d7220c-786e-4e24-8ae6-1e37cc134b59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 12:22:10.435965 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG oslo_db.sqlalchemy.engines [None req-842c203c-fa84-4b26-96bf-269a9b8805e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100730) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 12:22:10.787017 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: WARNING keystonemiddleware.auth_token [None req-d8d7220c-786e-4e24-8ae6-1e37cc134b59 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 12:22:10.787581 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: WARNING keystonemiddleware.auth_token [None req-842c203c-fa84-4b26-96bf-269a9b8805e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 12:22:10.793577 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: WARNING keystonemiddleware.auth_token [None req-842c203c-fa84-4b26-96bf-269a9b8805e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 12:22:10.793744 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: WARNING keystonemiddleware.auth_token [None req-d8d7220c-786e-4e24-8ae6-1e37cc134b59 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 12:22:11.145671 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: WARNING keystonemiddleware.auth_token [None req-842c203c-fa84-4b26-96bf-269a9b8805e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 12:22:11.150860 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: WARNING keystonemiddleware.auth_token [None req-842c203c-fa84-4b26-96bf-269a9b8805e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 12:22:11.155853 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: WARNING keystonemiddleware.auth_token [None req-d8d7220c-786e-4e24-8ae6-1e37cc134b59 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 12:22:11.157067 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5581117619c0 pid: 100730 (default app) Oct 28 12:22:11.159194 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-842c203c-fa84-4b26-96bf-269a9b8805e8 None None] Calling method '>' {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:11.160383 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-842c203c-fa84-4b26-96bf-269a9b8805e8 None None] 10.222.0.62 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001777 Oct 28 12:22:11.160802 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 788 bytes} [Thu Oct 28 12:22:11 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:22:11.161104 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: WARNING keystonemiddleware.auth_token [None req-d8d7220c-786e-4e24-8ae6-1e37cc134b59 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 12:22:11.167646 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5581117619c0 pid: 100731 (default app) Oct 28 12:23:35.355704 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-842c203c-fa84-4b26-96bf-269a9b8805e8 None None] Calling method '>' {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:35.357519 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-842c203c-fa84-4b26-96bf-269a9b8805e8 None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002156 Oct 28 12:23:35.367914 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 2/2] 10.222.0.62 () {54 vars in 930 bytes} [Thu Oct 28 12:23:35 2021] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:23:35.819299 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-c19154ac-0359-47e7-b83c-f04c7cb7ba72 admin admin] Calling method '>' {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:35.851652 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-c19154ac-0359-47e7-b83c-f04c7cb7ba72 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.485287 Oct 28 12:23:35.856809 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 1/3] 10.222.0.62 () {60 vars in 1291 bytes} [Thu Oct 28 12:23:35 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:23:38.182563 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-842c203c-fa84-4b26-96bf-269a9b8805e8 None None] Calling method '>' {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:38.183475 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-842c203c-fa84-4b26-96bf-269a9b8805e8 None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001786 Oct 28 12:23:38.183850 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 3/4] 10.222.0.62 () {54 vars in 930 bytes} [Thu Oct 28 12:23:38 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:23:38.247750 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-a285e7e9-4d1e-41c6-855b-a56bef2e2655 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "vcpus": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "cirros256", "id": "c1", "rxtx_factor": 1.0, "swap": 0}} {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:38.266847 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:23:38.266847 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: warnings.warn(msg) Oct 28 12:23:38.299765 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-a285e7e9-4d1e-41c6-855b-a56bef2e2655 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.108490 Oct 28 12:23:38.301269 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 2/5] 10.222.0.62 () {64 vars in 1282 bytes} [Thu Oct 28 12:23:38 2021] POST /compute/v2.1/flavors => generated 407 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:23:38.536289 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-3b25d677-1700-40b8-85e5-a2989db4b142 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:38.539497 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:23:38.539497 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: warnings.warn(msg) Oct 28 12:23:38.600983 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-3b25d677-1700-40b8-85e5-a2989db4b142 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.291066 Oct 28 12:23:38.602012 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 4/6] 10.222.0.62 () {64 vars in 1335 bytes} [Thu Oct 28 12:23:38 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:23:40.938663 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-a285e7e9-4d1e-41c6-855b-a56bef2e2655 admin admin] Calling method '>' {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:40.939694 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-a285e7e9-4d1e-41c6-855b-a56bef2e2655 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001642 Oct 28 12:23:40.940105 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 3/7] 10.222.0.62 () {54 vars in 930 bytes} [Thu Oct 28 12:23:40 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:23:41.071013 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-a7abf10c-b06a-4cb5-a868-370a73ada19c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "swap": 0, "rxtx_factor": 1.0, "name": "ds512M", "ram": 512, "id": "d1", "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:41.089614 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:23:41.089614 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: warnings.warn(msg) Oct 28 12:23:41.110692 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-a7abf10c-b06a-4cb5-a868-370a73ada19c admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.163111 Oct 28 12:23:41.111835 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 5/8] 10.222.0.62 () {64 vars in 1282 bytes} [Thu Oct 28 12:23:40 2021] POST /compute/v2.1/flavors => generated 404 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:23:41.124430 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-66d4b81f-b1aa-462c-9e2d-3f8c00f52724 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:41.125945 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:23:41.125945 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: warnings.warn(msg) Oct 28 12:23:41.163785 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-66d4b81f-b1aa-462c-9e2d-3f8c00f52724 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043068 Oct 28 12:23:41.164811 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 4/9] 10.222.0.62 () {64 vars in 1335 bytes} [Thu Oct 28 12:23:41 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:23:43.505060 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-a7abf10c-b06a-4cb5-a868-370a73ada19c admin admin] Calling method '>' {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:43.506065 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-a7abf10c-b06a-4cb5-a868-370a73ada19c admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001646 Oct 28 12:23:43.506461 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 6/10] 10.222.0.62 () {54 vars in 930 bytes} [Thu Oct 28 12:23:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:23:43.576342 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-75db2b05-29ff-4a2d-9d4c-ed613b7a7feb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "name": "ds1G", "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "ram": 1024, "os-flavor-access:is_public": true, "id": "d2"}} {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:43.594922 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-75db2b05-29ff-4a2d-9d4c-ed613b7a7feb admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081406 Oct 28 12:23:43.595881 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 5/11] 10.222.0.62 () {64 vars in 1282 bytes} [Thu Oct 28 12:23:43 2021] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:23:43.608350 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-eb880ff7-06c5-4533-b73c-bbed258f7c8d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:43.631968 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-eb880ff7-06c5-4533-b73c-bbed258f7c8d admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027348 Oct 28 12:23:43.637204 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 7/12] 10.222.0.62 () {64 vars in 1335 bytes} [Thu Oct 28 12:23:43 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:23:45.986253 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-75db2b05-29ff-4a2d-9d4c-ed613b7a7feb admin admin] Calling method '>' {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:45.987395 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-75db2b05-29ff-4a2d-9d4c-ed613b7a7feb admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 28 12:23:45.987812 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 6/13] 10.222.0.62 () {54 vars in 930 bytes} [Thu Oct 28 12:23:45 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:23:46.049722 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-807f6245-76e4-49a0-8c01-8f7c501c94ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "os-flavor-access:is_public": true, "swap": 0, "id": "d3", "disk": 10, "rxtx_factor": 1.0, "vcpus": 2, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:46.070043 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-807f6245-76e4-49a0-8c01-8f7c501c94ca admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074782 Oct 28 12:23:46.070591 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 8/14] 10.222.0.62 () {64 vars in 1282 bytes} [Thu Oct 28 12:23:45 2021] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:23:46.083605 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-c7b8fa4d-ec5e-40f9-bf3e-6c3c13ef1796 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:46.109582 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-c7b8fa4d-ec5e-40f9-bf3e-6c3c13ef1796 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029848 Oct 28 12:23:46.110393 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 7/15] 10.222.0.62 () {64 vars in 1335 bytes} [Thu Oct 28 12:23:46 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:23:48.457944 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-807f6245-76e4-49a0-8c01-8f7c501c94ca admin admin] Calling method '>' {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:48.458945 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-807f6245-76e4-49a0-8c01-8f7c501c94ca admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Oct 28 12:23:48.459337 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 9/16] 10.222.0.62 () {54 vars in 930 bytes} [Thu Oct 28 12:23:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:23:48.540984 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-a7bb3f34-662c-4d08-bef1-fbe01c6cc9a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "rxtx_factor": 1.0, "disk": 20, "swap": 0, "id": "d4", "name": "ds4G", "os-flavor-access:is_public": true}} {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:48.563191 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-a7bb3f34-662c-4d08-bef1-fbe01c6cc9a7 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.095909 Oct 28 12:23:48.563804 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 8/17] 10.222.0.62 () {64 vars in 1282 bytes} [Thu Oct 28 12:23:48 2021] POST /compute/v2.1/flavors => generated 404 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:23:48.576659 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-7b6a7bd6-95e0-4d66-806f-11959a5387e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:48.599745 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-7b6a7bd6-95e0-4d66-806f-11959a5387e0 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027048 Oct 28 12:23:48.602780 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 10/18] 10.222.0.62 () {64 vars in 1335 bytes} [Thu Oct 28 12:23:48 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:23:51.012318 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-a7bb3f34-662c-4d08-bef1-fbe01c6cc9a7 admin admin] Calling method '>' {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:51.013579 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-a7bb3f34-662c-4d08-bef1-fbe01c6cc9a7 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Oct 28 12:23:51.013981 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 9/19] 10.222.0.62 () {54 vars in 930 bytes} [Thu Oct 28 12:23:51 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:23:51.094413 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-d089e6d0-b53f-40da-925c-863369bf05b5 admin admin] Calling method '>' {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:51.126723 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-d089e6d0-b53f-40da-925c-863369bf05b5 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.102999 Oct 28 12:23:51.127912 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 11/20] 10.222.0.62 () {60 vars in 1291 bytes} [Thu Oct 28 12:23:51 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:23:53.849122 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-a7bb3f34-662c-4d08-bef1-fbe01c6cc9a7 admin admin] Calling method '>' {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:53.850178 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-a7bb3f34-662c-4d08-bef1-fbe01c6cc9a7 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001577 Oct 28 12:23:53.850600 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 10/21] 10.222.0.62 () {54 vars in 930 bytes} [Thu Oct 28 12:23:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:23:53.927802 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-a103b121-c73b-4b5b-8646-42705e845218 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "name": "m1.tiny", "disk": 1, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "1"}} {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:53.956413 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-a103b121-c73b-4b5b-8646-42705e845218 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.097935 Oct 28 12:23:53.957347 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 12/22] 10.222.0.62 () {64 vars in 1282 bytes} [Thu Oct 28 12:23:53 2021] POST /compute/v2.1/flavors => generated 402 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:23:53.973431 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-b4f648c0-4bd4-467a-b56d-724296a62760 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:53.998680 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-b4f648c0-4bd4-467a-b56d-724296a62760 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030590 Oct 28 12:23:53.999287 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 11/23] 10.222.0.62 () {64 vars in 1332 bytes} [Thu Oct 28 12:23:53 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:23:56.541021 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-a103b121-c73b-4b5b-8646-42705e845218 admin admin] Calling method '>' {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:56.542209 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-a103b121-c73b-4b5b-8646-42705e845218 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001753 Oct 28 12:23:56.542622 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 13/24] 10.222.0.62 () {54 vars in 930 bytes} [Thu Oct 28 12:23:56 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:23:56.612588 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-4860f693-dee7-4f7a-ab70-0107e176b6b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "id": "2", "swap": 0, "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:56.635475 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-4860f693-dee7-4f7a-ab70-0107e176b6b5 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.085113 Oct 28 12:23:56.636290 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 12/25] 10.222.0.62 () {64 vars in 1282 bytes} [Thu Oct 28 12:23:56 2021] POST /compute/v2.1/flavors => generated 405 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:23:56.653174 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-223b30b1-a02a-48c9-ae63-118627813495 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:56.678979 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-223b30b1-a02a-48c9-ae63-118627813495 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029729 Oct 28 12:23:56.679574 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 14/26] 10.222.0.62 () {64 vars in 1332 bytes} [Thu Oct 28 12:23:56 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:23:59.079068 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-4860f693-dee7-4f7a-ab70-0107e176b6b5 admin admin] Calling method '>' {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:59.080217 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-4860f693-dee7-4f7a-ab70-0107e176b6b5 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 Oct 28 12:23:59.080840 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 13/27] 10.222.0.62 () {54 vars in 930 bytes} [Thu Oct 28 12:23:59 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:23:59.141499 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-36b5188a-8485-4a63-9d59-65e755264c3e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "id": "3", "swap": 0, "ram": 4096, "rxtx_factor": 1.0}} {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:59.163558 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-36b5188a-8485-4a63-9d59-65e755264c3e admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.076459 Oct 28 12:23:59.164070 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 15/28] 10.222.0.62 () {64 vars in 1282 bytes} [Thu Oct 28 12:23:59 2021] POST /compute/v2.1/flavors => generated 406 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:23:59.177309 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-5fd3f114-6803-4079-b24e-c855429d515b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:59.204941 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-5fd3f114-6803-4079-b24e-c855429d515b admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031293 Oct 28 12:23:59.205558 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 14/29] 10.222.0.62 () {64 vars in 1332 bytes} [Thu Oct 28 12:23:59 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:24:01.550299 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-36b5188a-8485-4a63-9d59-65e755264c3e admin admin] Calling method '>' {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:01.551298 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-36b5188a-8485-4a63-9d59-65e755264c3e admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Oct 28 12:24:01.551699 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 16/30] 10.222.0.62 () {54 vars in 930 bytes} [Thu Oct 28 12:24:01 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:24:01.611514 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-5c6c590f-db3a-4907-beb5-258b6ca36004 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "disk": 80, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "4", "ram": 8192}} {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:01.630465 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-5c6c590f-db3a-4907-beb5-258b6ca36004 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071104 Oct 28 12:24:01.631232 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 15/31] 10.222.0.62 () {64 vars in 1282 bytes} [Thu Oct 28 12:24:01 2021] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:24:01.646079 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-86ce3b96-8e72-4d48-a222-4b6c7da68691 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:01.676659 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-86ce3b96-8e72-4d48-a222-4b6c7da68691 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034519 Oct 28 12:24:01.677760 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 17/32] 10.222.0.62 () {64 vars in 1332 bytes} [Thu Oct 28 12:24:01 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:24:04.081429 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-5c6c590f-db3a-4907-beb5-258b6ca36004 admin admin] Calling method '>' {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:04.083040 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-5c6c590f-db3a-4907-beb5-258b6ca36004 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002329 Oct 28 12:24:04.083601 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 16/33] 10.222.0.62 () {54 vars in 930 bytes} [Thu Oct 28 12:24:04 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:24:04.155315 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-483ba73a-5e49-4d34-9a43-07544dc16018 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "swap": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "ram": 16384, "vcpus": 8, "id": "5"}} {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:04.176038 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-483ba73a-5e49-4d34-9a43-07544dc16018 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.085888 Oct 28 12:24:04.176593 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 18/34] 10.222.0.62 () {64 vars in 1282 bytes} [Thu Oct 28 12:24:04 2021] POST /compute/v2.1/flavors => generated 408 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:04.189966 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-3ec8ccb7-a1b9-4bd4-8fe3-4c66a6d9414a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:04.218515 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-3ec8ccb7-a1b9-4bd4-8fe3-4c66a6d9414a admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032448 Oct 28 12:24:04.219519 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 17/35] 10.222.0.62 () {64 vars in 1332 bytes} [Thu Oct 28 12:24:04 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:24:46.187659 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-483ba73a-5e49-4d34-9a43-07544dc16018 admin admin] Calling method '>' {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:46.188672 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-483ba73a-5e49-4d34-9a43-07544dc16018 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Oct 28 12:24:46.189652 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 19/36] 10.222.0.62 () {54 vars in 930 bytes} [Thu Oct 28 12:24:46 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:24:46.264698 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-331abcbf-b0b0-438a-a2e5-66176a490ee3 admin admin] Calling method '>' {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:46.282315 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-331abcbf-b0b0-438a-a2e5-66176a490ee3 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.085920 Oct 28 12:24:46.282862 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 18/37] 10.222.0.62 () {60 vars in 1291 bytes} [Thu Oct 28 12:24:46 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:24:47.818976 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-483ba73a-5e49-4d34-9a43-07544dc16018 admin admin] Calling method '>' {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:47.819974 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-483ba73a-5e49-4d34-9a43-07544dc16018 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Oct 28 12:24:47.820430 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 20/38] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Oct 28 12:24:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:24:48.028333 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-f8658629-bffc-4d89-b765-03b52d827ef7 admin admin] Calling method '>' {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:48.034045 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.wsgi [None req-f8658629-bffc-4d89-b765-03b52d827ef7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 28 12:24:48.034606 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-f8658629-bffc-4d89-b765-03b52d827ef7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=100731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:24:48.035401 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-f8658629-bffc-4d89-b765-03b52d827ef7 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.074618 Oct 28 12:24:48.035905 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 19/39] 10.222.0.62 () {60 vars in 1190 bytes} [Thu Oct 28 12:24:47 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 12:24:48.046019 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-a75edf1c-52d6-4619-a337-f283c37eae48 admin admin] Calling method '>' {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:48.067142 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-a75edf1c-52d6-4619-a337-f283c37eae48 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024669 Oct 28 12:24:48.067684 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 21/40] 10.222.0.62 () {60 vars in 1210 bytes} [Thu Oct 28 12:24:48 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:24:48.080702 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-3b53a389-a27e-424d-932d-e283c59dc794 admin admin] Calling method '>' {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:48.102585 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-3b53a389-a27e-424d-932d-e283c59dc794 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027505 Oct 28 12:24:48.103194 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 20/41] 10.222.0.62 () {60 vars in 1210 bytes} [Thu Oct 28 12:24:48 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:24:48.113804 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-700f0a8b-9a4f-4796-aa91-5e0048b867e5 admin admin] Calling method '>' {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:48.119845 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.wsgi [None req-700f0a8b-9a4f-4796-aa91-5e0048b867e5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 28 12:24:48.120416 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-700f0a8b-9a4f-4796-aa91-5e0048b867e5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=100730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:24:48.121264 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-700f0a8b-9a4f-4796-aa91-5e0048b867e5 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011215 Oct 28 12:24:48.121778 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 22/42] 10.222.0.62 () {60 vars in 1190 bytes} [Thu Oct 28 12:24:48 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 12:24:49.560892 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-3b53a389-a27e-424d-932d-e283c59dc794 admin admin] Calling method '>' {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:49.562037 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-3b53a389-a27e-424d-932d-e283c59dc794 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001675 Oct 28 12:24:49.562644 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 21/43] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Oct 28 12:24:49 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:24:49.772604 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-4b00f00d-4486-42be-af3e-76dc1cc0ba97 admin admin] Calling method '>' {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:49.780739 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.wsgi [None req-4b00f00d-4486-42be-af3e-76dc1cc0ba97 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 28 12:24:49.781325 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-4b00f00d-4486-42be-af3e-76dc1cc0ba97 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=100730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:24:49.782121 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-4b00f00d-4486-42be-af3e-76dc1cc0ba97 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.079535 Oct 28 12:24:49.782650 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 23/44] 10.222.0.62 () {60 vars in 1190 bytes} [Thu Oct 28 12:24:49 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 12:24:49.797015 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-63476613-a25a-4b1f-850a-95ce1ae2687b admin admin] Calling method '>' {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:49.818060 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-63476613-a25a-4b1f-850a-95ce1ae2687b admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026503 Oct 28 12:24:49.818929 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 22/45] 10.222.0.62 () {60 vars in 1210 bytes} [Thu Oct 28 12:24:49 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:24:49.831984 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-5c88211a-7d42-4637-98df-12a55fe5fce6 admin admin] Calling method '>' {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:49.846214 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-5c88211a-7d42-4637-98df-12a55fe5fce6 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017758 Oct 28 12:24:49.846727 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 24/46] 10.222.0.62 () {60 vars in 1210 bytes} [Thu Oct 28 12:24:49 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:24:49.856758 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-3552aed1-9f5e-410f-b1cf-89e67b70b71a admin admin] Calling method '>' {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:49.862666 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.wsgi [None req-3552aed1-9f5e-410f-b1cf-89e67b70b71a admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 28 12:24:49.863231 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-3552aed1-9f5e-410f-b1cf-89e67b70b71a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=100731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:24:49.864019 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-3552aed1-9f5e-410f-b1cf-89e67b70b71a admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010830 Oct 28 12:24:49.864510 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 23/47] 10.222.0.62 () {60 vars in 1190 bytes} [Thu Oct 28 12:24:49 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 12:24:51.302573 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-5c88211a-7d42-4637-98df-12a55fe5fce6 admin admin] Calling method '>' {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:51.303560 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-5c88211a-7d42-4637-98df-12a55fe5fce6 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Oct 28 12:24:51.303957 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 25/48] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Oct 28 12:24:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:24:51.523718 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-d46bcd51-ea10-45f7-a00b-5b4d0d635868 admin admin] Calling method '>' {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:51.530010 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.wsgi [None req-d46bcd51-ea10-45f7-a00b-5b4d0d635868 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 28 12:24:51.530600 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-d46bcd51-ea10-45f7-a00b-5b4d0d635868 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=100731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:24:51.531376 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-d46bcd51-ea10-45f7-a00b-5b4d0d635868 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.071244 Oct 28 12:24:51.531894 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 24/49] 10.222.0.62 () {60 vars in 1193 bytes} [Thu Oct 28 12:24:51 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 28 12:24:51.543377 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-c12c6af8-c9ac-45ed-a846-564ebf95c1a3 admin admin] Calling method '>' {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:51.557055 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-c12c6af8-c9ac-45ed-a846-564ebf95c1a3 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017165 Oct 28 12:24:51.557589 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 26/50] 10.222.0.62 () {60 vars in 1210 bytes} [Thu Oct 28 12:24:51 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:24:51.568410 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-e68da657-7c1a-45c2-ac60-e28813df4a78 admin admin] Calling method '>' {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:51.583039 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-e68da657-7c1a-45c2-ac60-e28813df4a78 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018198 Oct 28 12:24:51.583610 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 25/51] 10.222.0.62 () {60 vars in 1210 bytes} [Thu Oct 28 12:24:51 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:24:51.596966 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-30c8531a-21ad-43ec-a557-f220bf4021e3 admin admin] Calling method '>' {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:51.602604 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.wsgi [None req-30c8531a-21ad-43ec-a557-f220bf4021e3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 28 12:24:51.603162 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-30c8531a-21ad-43ec-a557-f220bf4021e3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=100730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:24:51.603945 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-30c8531a-21ad-43ec-a557-f220bf4021e3 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010698 Oct 28 12:24:51.604439 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 27/52] 10.222.0.62 () {60 vars in 1193 bytes} [Thu Oct 28 12:24:51 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 12:24:53.055975 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-e68da657-7c1a-45c2-ac60-e28813df4a78 admin admin] Calling method '>' {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:53.057014 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-e68da657-7c1a-45c2-ac60-e28813df4a78 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Oct 28 12:24:53.057413 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 26/53] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Oct 28 12:24:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:24:53.258684 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-2cf644a1-e377-4527-9fa8-98ea623430a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:53.278861 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-2cf644a1-e377-4527-9fa8-98ea623430a4 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.079934 Oct 28 12:24:53.279388 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 28/54] 10.222.0.62 () {64 vars in 1235 bytes} [Thu Oct 28 12:24:53 2021] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:54.719200 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-e68da657-7c1a-45c2-ac60-e28813df4a78 admin admin] Calling method '>' {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:54.720785 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-e68da657-7c1a-45c2-ac60-e28813df4a78 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002269 Oct 28 12:24:54.721549 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 27/55] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Oct 28 12:24:54 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:24:54.925742 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-c7b09cc3-4981-4895-a81b-3c46e07cafa5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:54.945838 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-c7b09cc3-4981-4895-a81b-3c46e07cafa5 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.073655 Oct 28 12:24:54.946377 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 29/56] 10.222.0.62 () {64 vars in 1235 bytes} [Thu Oct 28 12:24:54 2021] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:56.377487 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-e68da657-7c1a-45c2-ac60-e28813df4a78 admin admin] Calling method '>' {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:56.378832 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-e68da657-7c1a-45c2-ac60-e28813df4a78 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001971 Oct 28 12:24:56.379293 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 28/57] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Oct 28 12:24:56 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:24:56.589875 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-f08cdb6f-3c8c-44a8-9f74-99041ca23b8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:56.610483 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-f08cdb6f-3c8c-44a8-9f74-99041ca23b8f admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.081472 Oct 28 12:24:56.611023 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 30/58] 10.222.0.62 () {64 vars in 1235 bytes} [Thu Oct 28 12:24:56 2021] POST /compute/v2.1/flavors => generated 407 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:58.040298 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-e68da657-7c1a-45c2-ac60-e28813df4a78 admin admin] Calling method '>' {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:58.041359 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-e68da657-7c1a-45c2-ac60-e28813df4a78 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Oct 28 12:24:58.041740 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 29/59] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Oct 28 12:24:58 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:24:58.246188 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-acccb7b1-3ac1-4caf-976a-d04a7f8e67bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:58.266957 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-acccb7b1-3ac1-4caf-976a-d04a7f8e67bf admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.088727 Oct 28 12:24:58.267509 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 31/60] 10.222.0.62 () {64 vars in 1235 bytes} [Thu Oct 28 12:24:58 2021] POST /compute/v2.1/flavors => generated 409 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:59.697102 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-e68da657-7c1a-45c2-ac60-e28813df4a78 admin admin] Calling method '>' {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:59.698109 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-e68da657-7c1a-45c2-ac60-e28813df4a78 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Oct 28 12:24:59.698528 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 30/61] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Oct 28 12:24:59 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:24:59.900952 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-67ff38cd-3031-4ab3-b18f-5cfd984a8f99 admin admin] Calling method '>' {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:59.920568 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-67ff38cd-3031-4ab3-b18f-5cfd984a8f99 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073709 Oct 28 12:24:59.921111 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 32/62] 10.222.0.62 () {60 vars in 1202 bytes} [Thu Oct 28 12:24:59 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:25:47.065842 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-e68da657-7c1a-45c2-ac60-e28813df4a78 admin admin] Calling method '>' {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:25:47.067332 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-e68da657-7c1a-45c2-ac60-e28813df4a78 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002129 Oct 28 12:25:47.067957 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 31/63] 10.222.0.62 () {54 vars in 930 bytes} [Thu Oct 28 12:25:47 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:25:47.132697 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-8148777c-d025-42e7-8545-92af12c945ed admin admin] Calling method '>' {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:25:47.153278 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-8148777c-d025-42e7-8545-92af12c945ed admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.077817 Oct 28 12:25:47.153832 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 33/64] 10.222.0.62 () {60 vars in 1291 bytes} [Thu Oct 28 12:25:47 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:25:47.178508 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-e19b1243-6fda-4cdd-8beb-e32c9d1f5d0c admin admin] Calling method '>' {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:25:47.189116 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-e19b1243-6fda-4cdd-8beb-e32c9d1f5d0c admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016196 Oct 28 12:25:47.189816 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 32/65] 10.222.0.62 () {60 vars in 1282 bytes} [Thu Oct 28 12:25:47 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:25:47.206483 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-6a5b7efe-32fa-42e6-b554-87f4401a5703 admin admin] Calling method '>' {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:25:47.214595 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-6a5b7efe-32fa-42e6-b554-87f4401a5703 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011768 Oct 28 12:25:47.215161 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 34/66] 10.222.0.62 () {60 vars in 1285 bytes} [Thu Oct 28 12:25:47 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:25:47.227526 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-d6d37902-2c74-4356-9015-67db5a011395 admin admin] Calling method '>' {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:25:47.235498 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-d6d37902-2c74-4356-9015-67db5a011395 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011885 Oct 28 12:25:47.235945 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 33/67] 10.222.0.62 () {60 vars in 1285 bytes} [Thu Oct 28 12:25:47 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:25:47.248412 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-6141d015-b6fe-498b-b3c3-2f495418888b admin admin] Calling method '>' {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:25:47.256759 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-6141d015-b6fe-498b-b3c3-2f495418888b admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011926 Oct 28 12:25:47.257281 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 35/68] 10.222.0.62 () {60 vars in 1282 bytes} [Thu Oct 28 12:25:47 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:27:08.808627 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-82fe8eae-9342-4ba1-aad1-67f87a9fe82a tempest-verify_tempest_config-1688249819 tempest-verify_tempest_config-1688249819-project] Calling method '>' {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:27:08.811031 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-82fe8eae-9342-4ba1-aad1-67f87a9fe82a tempest-verify_tempest_config-1688249819 tempest-verify_tempest_config-1688249819-project] 10.222.0.62 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.116875 Oct 28 12:27:08.811564 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 34/69] 10.222.0.62 () {58 vars in 1133 bytes} [Thu Oct 28 12:27:08 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:28:38.514753 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-6141d015-b6fe-498b-b3c3-2f495418888b admin admin] Calling method '>' {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:28:38.515875 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-6141d015-b6fe-498b-b3c3-2f495418888b admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001622 Oct 28 12:28:38.516288 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 36/70] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Oct 28 12:28:38 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:28:38.815235 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-9185cb7c-aa33-4e1d-a7d9-ad1bb673b16e admin admin] Calling method '>' {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:28:38.816390 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:28:38.816390 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: warnings.warn(msg) Oct 28 12:28:38.818038 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG oslo_concurrency.lockutils [None req-9185cb7c-aa33-4e1d-a7d9-ad1bb673b16e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:38.818444 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG oslo_concurrency.lockutils [None req-9185cb7c-aa33-4e1d-a7d9-ad1bb673b16e admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:38.819216 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG oslo_concurrency.lockutils [None req-9185cb7c-aa33-4e1d-a7d9-ad1bb673b16e admin admin] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:38.819628 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG oslo_concurrency.lockutils [None req-9185cb7c-aa33-4e1d-a7d9-ad1bb673b16e admin admin] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:38.853604 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-9185cb7c-aa33-4e1d-a7d9-ad1bb673b16e admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.181406 Oct 28 12:28:38.854213 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 35/71] 10.222.0.62 () {60 vars in 1193 bytes} [Thu Oct 28 12:28:38 2021] GET /compute/v2.1/os-services => generated 791 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:28:40.311248 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-6141d015-b6fe-498b-b3c3-2f495418888b admin admin] Calling method '>' {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:28:40.312941 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-6141d015-b6fe-498b-b3c3-2f495418888b admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002323 Oct 28 12:28:40.313440 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 37/72] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Oct 28 12:28:40 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:28:40.516386 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-577a71ca-8615-42a5-9081-60bfada8974d admin admin] Calling method '>' {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:28:40.517850 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:28:40.517850 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: warnings.warn(msg) Oct 28 12:28:40.519367 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG oslo_concurrency.lockutils [None req-577a71ca-8615-42a5-9081-60bfada8974d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:40.519832 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG oslo_concurrency.lockutils [None req-577a71ca-8615-42a5-9081-60bfada8974d admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:40.520608 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG oslo_concurrency.lockutils [None req-577a71ca-8615-42a5-9081-60bfada8974d admin admin] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:40.521054 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG oslo_concurrency.lockutils [None req-577a71ca-8615-42a5-9081-60bfada8974d admin admin] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:40.540106 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-577a71ca-8615-42a5-9081-60bfada8974d admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.081023 Oct 28 12:28:40.540670 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 36/73] 10.222.0.62 () {60 vars in 1193 bytes} [Thu Oct 28 12:28:40 2021] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:28:52.432177 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-6141d015-b6fe-498b-b3c3-2f495418888b admin admin] Calling method '>' {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:28:52.433208 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-6141d015-b6fe-498b-b3c3-2f495418888b admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Oct 28 12:28:52.433588 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 38/74] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Oct 28 12:28:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:28:52.632179 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-c299c5a0-a97c-453a-848e-62ceaa67dfd8 admin admin] Calling method '>' {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:28:52.633374 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:28:52.633374 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: warnings.warn(msg) Oct 28 12:28:52.634864 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG oslo_concurrency.lockutils [None req-c299c5a0-a97c-453a-848e-62ceaa67dfd8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:52.635301 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG oslo_concurrency.lockutils [None req-c299c5a0-a97c-453a-848e-62ceaa67dfd8 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:52.636058 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG oslo_concurrency.lockutils [None req-c299c5a0-a97c-453a-848e-62ceaa67dfd8 admin admin] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:52.636470 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG oslo_concurrency.lockutils [None req-c299c5a0-a97c-453a-848e-62ceaa67dfd8 admin admin] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:52.660656 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-c299c5a0-a97c-453a-848e-62ceaa67dfd8 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084130 Oct 28 12:28:52.661242 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 37/75] 10.222.0.62 () {60 vars in 1193 bytes} [Thu Oct 28 12:28:52 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:28:54.162808 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: DEBUG nova.api.openstack.wsgi [None req-6141d015-b6fe-498b-b3c3-2f495418888b admin admin] Calling method '>' {{(pid=100730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:28:54.163810 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: INFO nova.api.openstack.requestlog [None req-6141d015-b6fe-498b-b3c3-2f495418888b admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002061 Oct 28 12:28:54.164202 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: [pid: 100730|app: 0|req: 39/76] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Oct 28 12:28:54 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:28:54.363397 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG nova.api.openstack.wsgi [None req-cb99078b-8229-4a52-a2d7-0882dbb47502 admin admin] Calling method '>' {{(pid=100731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:28:54.364566 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:28:54.364566 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: warnings.warn(msg) Oct 28 12:28:54.366176 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG oslo_concurrency.lockutils [None req-cb99078b-8229-4a52-a2d7-0882dbb47502 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:54.366564 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG oslo_concurrency.lockutils [None req-cb99078b-8229-4a52-a2d7-0882dbb47502 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:54.367363 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG oslo_concurrency.lockutils [None req-cb99078b-8229-4a52-a2d7-0882dbb47502 admin admin] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:54.367781 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: DEBUG oslo_concurrency.lockutils [None req-cb99078b-8229-4a52-a2d7-0882dbb47502 admin admin] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:54.388883 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: INFO nova.api.openstack.requestlog [None req-cb99078b-8229-4a52-a2d7-0882dbb47502 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081431 Oct 28 12:28:54.389469 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: [pid: 100731|app: 0|req: 38/77] 10.222.0.62 () {60 vars in 1193 bytes} [Thu Oct 28 12:28:54 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:29:51.109668 dv-cinder-815146-6-iscsi devstack@n-api.service[100729]: Thu Oct 28 12:29:51 2021 - graceful shutdown triggered... Oct 28 12:29:51.108900 dv-cinder-815146-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 28 12:29:51.112171 dv-cinder-815146-6-iscsi devstack@n-api.service[100730]: Gracefully killing worker 1 (pid: 100730)... Oct 28 12:29:51.112576 dv-cinder-815146-6-iscsi devstack@n-api.service[100731]: Gracefully killing worker 2 (pid: 100731)... Oct 28 12:29:52.110040 dv-cinder-815146-6-iscsi devstack@n-api.service[100729]: worker 1 buried after 1 seconds Oct 28 12:29:52.110040 dv-cinder-815146-6-iscsi devstack@n-api.service[100729]: worker 2 buried after 1 seconds Oct 28 12:29:52.110040 dv-cinder-815146-6-iscsi devstack@n-api.service[100729]: goodbye to uWSGI. Oct 28 12:29:52.111740 dv-cinder-815146-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 28 12:29:52.112305 dv-cinder-815146-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 28 12:29:52.115223 dv-cinder-815146-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 28 12:29:52.125055 dv-cinder-815146-6-iscsi devstack@n-api.service[115857]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 28 12:29:52.127711 dv-cinder-815146-6-iscsi devstack@n-api.service[115857]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 28 12:29:52 2021] *** Oct 28 12:29:52.127867 dv-cinder-815146-6-iscsi devstack@n-api.service[115857]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 12:29:52.128001 dv-cinder-815146-6-iscsi devstack@n-api.service[115857]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 12:29:52.128114 dv-cinder-815146-6-iscsi devstack@n-api.service[115857]: nodename: dv-cinder-815146-6-iscsi Oct 28 12:29:52.128224 dv-cinder-815146-6-iscsi devstack@n-api.service[115857]: machine: x86_64 Oct 28 12:29:52.128332 dv-cinder-815146-6-iscsi devstack@n-api.service[115857]: clock source: unix Oct 28 12:29:52.128438 dv-cinder-815146-6-iscsi devstack@n-api.service[115857]: pcre jit disabled Oct 28 12:29:52.128563 dv-cinder-815146-6-iscsi devstack@n-api.service[115857]: detected number of CPU cores: 4 Oct 28 12:29:52.128671 dv-cinder-815146-6-iscsi devstack@n-api.service[115857]: current working directory: / Oct 28 12:29:52.128796 dv-cinder-815146-6-iscsi devstack@n-api.service[115857]: detected binary path: /usr/bin/uwsgi-core Oct 28 12:29:52.128908 dv-cinder-815146-6-iscsi devstack@n-api.service[115857]: your processes number limit is 47680 Oct 28 12:29:52.129062 dv-cinder-815146-6-iscsi devstack@n-api.service[115857]: your memory page size is 4096 bytes Oct 28 12:29:52.129062 dv-cinder-815146-6-iscsi devstack@n-api.service[115857]: detected max file descriptor number: 2048 Oct 28 12:29:52.129062 dv-cinder-815146-6-iscsi devstack@n-api.service[115857]: lock engine: pthread robust mutexes Oct 28 12:29:52.129334 dv-cinder-815146-6-iscsi devstack@n-api.service[115857]: thunder lock: enabled Oct 28 12:29:52.129527 dv-cinder-815146-6-iscsi devstack@n-api.service[115857]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 28 12:29:52.129626 dv-cinder-815146-6-iscsi devstack@n-api.service[115857]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 28 12:29:52.174287 dv-cinder-815146-6-iscsi devstack@n-api.service[115857]: Python main interpreter initialized at 0x55c053ec49c0 Oct 28 12:29:52.174287 dv-cinder-815146-6-iscsi devstack@n-api.service[115857]: python threads support enabled Oct 28 12:29:52.174287 dv-cinder-815146-6-iscsi devstack@n-api.service[115857]: your server socket listen backlog is limited to 100 connections Oct 28 12:29:52.174287 dv-cinder-815146-6-iscsi devstack@n-api.service[115857]: your mercy for graceful operations on workers is 90 seconds Oct 28 12:29:52.174744 dv-cinder-815146-6-iscsi devstack@n-api.service[115857]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 12:29:52.174744 dv-cinder-815146-6-iscsi devstack@n-api.service[115857]: *** Operational MODE: preforking *** Oct 28 12:29:52.175040 dv-cinder-815146-6-iscsi devstack@n-api.service[115857]: *** uWSGI is running in multiple interpreter mode *** Oct 28 12:29:52.175040 dv-cinder-815146-6-iscsi devstack@n-api.service[115857]: spawned uWSGI master process (pid: 115857) Oct 28 12:29:52.175267 dv-cinder-815146-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 28 12:29:52.175824 dv-cinder-815146-6-iscsi devstack@n-api.service[115857]: spawned uWSGI worker 1 (pid: 115876, cores: 1) Oct 28 12:29:52.176171 dv-cinder-815146-6-iscsi devstack@n-api.service[115857]: spawned uWSGI worker 2 (pid: 115877, cores: 1) Oct 28 12:29:52.176474 dv-cinder-815146-6-iscsi devstack@n-api.service[115857]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 12:29:53.989108 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 12:29:53.989108 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: from cryptography.utils import int_from_bytes Oct 28 12:29:53.990719 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 12:29:53.990719 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: from cryptography.utils import int_from_bytes Oct 28 12:29:53.999481 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 12:29:53.999481 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: from cryptography.utils import int_from_bytes Oct 28 12:29:54.001344 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 12:29:54.001344 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: from cryptography.utils import int_from_bytes Oct 28 12:29:56.611812 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 12:29:56.612461 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 12:29:56.612557 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 12:29:56.612992 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 12:29:56.613246 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 12:29:56.613629 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.613948 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.614274 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.614582 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.614908 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.615210 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.615519 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.615834 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.616152 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.616388 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.616701 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.617055 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815146-6-iscsi {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.617370 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.617670 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.617959 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.618278 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.618587 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.618905 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.619211 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.619707 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.620451 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.620847 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.621158 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.621497 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.621808 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.622133 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.622440 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.622742 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.623954 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.623954 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.623954 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815146-6-iscsi {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.624187 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.624395 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.624658 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.625133 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.625450 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.626033 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.626251 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.626572 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.626876 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.627209 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.627528 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.637151 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.637151 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.637151 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.637151 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.637151 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.637151 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.637151 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.637151 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.638886 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.638886 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.638886 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.638886 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.638886 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.638886 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.638886 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.639747 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.639747 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.639747 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.639747 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.639747 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.639747 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.639747 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.639747 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.640569 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.640569 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.640569 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.640569 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.640569 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.640569 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.640569 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.640569 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.641435 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.641435 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.641435 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.641435 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.641435 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.641435 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.641435 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.641435 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.642279 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.642279 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.642279 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.642279 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.642279 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.642279 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.642279 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.642279 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.643141 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.643141 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.643141 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.643141 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.643141 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.643840 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.643840 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.644072 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.644190 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.644471 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.644790 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.645329 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.645836 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.646137 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.646454 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.646770 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.647074 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.647374 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.647673 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.647978 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.648292 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.648591 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.648917 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.649238 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.649537 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.649834 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.650147 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.650447 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.650746 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.651072 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.651353 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.651651 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.652000 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.652301 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.652597 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.652912 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.653208 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.653502 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.653797 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.654091 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.654391 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.654683 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.654992 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.655146 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 12:29:56.656153 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.656308 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 12:29:56.656461 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.656611 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 12:29:56.656788 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.656788 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.657077 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 12:29:56.657077 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 12:29:56.657360 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.657503 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.657650 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.657801 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.657949 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.658100 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.658247 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.658402 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.658563 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.658714 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.658863 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.659090 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.659232 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.659382 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.659534 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.659688 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.659830 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.659970 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.660110 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.660258 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.660410 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.660563 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.660705 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.660928 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815146-6-iscsi {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.661081 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.661231 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.661396 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.661542 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.661683 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.661824 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.661973 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.662114 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.662264 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.662423 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.662563 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.662712 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.662854 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.663003 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.663160 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.663160 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.663446 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.663619 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.663769 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.663925 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.664066 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.664216 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.664368 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.664517 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.664674 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.664674 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.664969 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.665110 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.665251 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.665406 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.665564 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.665712 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.666500 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.666663 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.666815 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.666967 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.667119 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.667262 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815146-6-iscsi {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.667453 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.667627 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.667780 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.667932 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.668084 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.668226 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.668367 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.668367 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.668653 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.668838 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.669048 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.669208 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.669359 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.669501 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.669656 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.669799 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.669948 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.670099 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.670249 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.670391 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.670540 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.670693 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.670834 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.670983 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.671125 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.671274 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.671438 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.671589 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.671738 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.671880 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.672028 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.672184 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.672328 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.672490 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.672639 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.672824 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.672969 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.673124 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.673275 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.673275 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.673563 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.673563 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.673830 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.673980 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.673980 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.674258 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.674417 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.674417 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.674692 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.674847 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.674847 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.675123 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.675271 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.675421 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.675655 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.675806 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.675976 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.676661 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.676846 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.676989 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.677146 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.677297 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.677447 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.677589 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.677746 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.677902 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.678055 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.678197 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.678337 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.678488 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.678639 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.678790 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.678932 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.679072 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.679219 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.679360 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.679548 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.679715 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.679858 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.679999 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.680140 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.680290 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.680432 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.680598 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.680812 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.680972 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.681114 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.681263 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.681430 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.681646 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.681794 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.681943 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.682084 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.682225 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.682380 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.682532 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.682685 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.682685 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.682953 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.683132 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.683289 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.683431 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.683571 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.683720 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.683870 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.684011 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.684164 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.684321 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.684483 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.684626 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.684785 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.684943 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.685096 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.685247 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.685397 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.685758 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.685919 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.686069 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.687031 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.687031 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.687328 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.687490 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.687640 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.687790 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.687947 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.688131 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.688282 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.688475 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.688620 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.688874 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.689039 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.689190 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.689332 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.689480 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.689633 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.689774 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.689924 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.690075 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.690224 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.690366 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.690507 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.690647 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.690801 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.690943 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.691093 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.691243 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.691402 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.691569 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.691712 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.691861 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.692003 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.692227 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.692371 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.692522 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.692664 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.692842 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.692994 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.693144 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.693299 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.693441 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.693593 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.693741 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.693892 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.694035 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.694176 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.694326 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.694475 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.694637 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.694788 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.694937 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.695078 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.695219 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.695368 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.695533 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.695675 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.695824 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.695966 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.696114 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.696264 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.696421 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.696565 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.697306 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.697460 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.697612 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.697755 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.697923 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.698067 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.698208 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.698348 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.698489 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.698737 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.698967 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.699207 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.699441 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.699659 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.699902 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.700245 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.700472 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.700776 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.701035 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.701302 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.701546 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.701796 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.702015 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.702253 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.702492 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.702736 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.703036 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.703291 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.703529 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.703771 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.704093 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.704289 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.704453 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.704598 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.704777 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:29:56.704928 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.705069 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.705218 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.705374 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.705517 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.705517 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.707685 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.707850 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.708012 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.708170 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.708322 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.708468 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.709266 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.709422 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.709565 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.709722 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.709865 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.710016 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.710159 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.710309 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.710473 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.710624 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.710774 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.710916 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.711059 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.711200 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.711355 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.712994 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.713358 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.713548 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.713708 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.713863 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.714023 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.714188 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.714373 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.714527 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.714683 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.714832 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.714990 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.715149 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.715308 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.715308 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.715599 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.715755 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.715904 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.715904 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.716213 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.716363 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.718557 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.718751 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.718905 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.719057 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.719206 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.719365 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.719513 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.719672 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.719822 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.719979 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.720141 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.720298 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.720448 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.720605 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.720786 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.720942 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.721099 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.721256 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.721414 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.721572 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.721720 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.721869 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.722024 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.722192 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.722356 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.722512 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.722695 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.723409 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.723571 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.723721 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.723881 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.724040 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.724190 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.724346 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.724495 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.724645 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.724842 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.724995 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.725142 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.725142 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.725142 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.725580 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.725739 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.725896 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.726045 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.726200 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.726356 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.726514 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.726672 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.726841 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.726998 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.727147 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.727304 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.727462 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.727632 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.728202 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.728353 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.728906 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.729074 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.729074 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.729388 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.729388 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.729699 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.729887 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.730085 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.730242 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.730390 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.730390 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.730690 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.730839 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.731002 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.731152 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.731300 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.731448 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.731621 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.731809 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.731974 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.732124 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.732272 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.732420 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.732568 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.732779 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.732949 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.732949 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.733253 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.733421 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.733570 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.733731 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.733879 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.734039 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.734188 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.734351 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.734513 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.734669 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.734817 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.734972 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.734972 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.734972 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.734972 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.734972 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.734972 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.734972 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.734972 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.736188 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.736336 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.736491 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.736638 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.736813 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.737050 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.737203 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.737203 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.737203 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.737203 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.737203 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.737203 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.737203 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.737203 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.739157 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.739314 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.739471 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.739634 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.739791 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.739939 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.740087 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.740087 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.740087 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.740087 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.740087 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.740087 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.740087 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.740087 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.741269 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.741418 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.741566 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.741713 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.741868 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.742025 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.742187 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.742354 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.742512 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.742670 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.742826 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.742975 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.743132 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.743289 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.743289 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.743726 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.743895 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.744060 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.744210 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.744358 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.744518 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.744666 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.744887 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.745049 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.745212 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.745365 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.745365 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.745715 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.745873 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.746032 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.746032 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.746322 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.746491 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.746641 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.746788 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.746945 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.747101 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.747257 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.747406 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.747554 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.747711 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.747861 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.748017 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.748454 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.748691 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.748878 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.749064 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.749411 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.749566 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.749714 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.749863 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.750019 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.750177 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.750340 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.750490 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.750649 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.750877 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.751033 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.751326 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.751502 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.751664 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.751823 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.751981 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.752139 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.752296 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.752296 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.752602 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.752881 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.753051 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.753220 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.753370 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.753531 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.753679 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.753827 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.753984 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.754148 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.754309 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.754459 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.754622 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.754778 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.754935 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.755094 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.755253 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.755402 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.755560 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.755709 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.755867 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.756015 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.756172 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.759380 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.759839 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.760000 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.760171 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.760341 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.760504 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.760664 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.760870 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.761030 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.761354 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.761514 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.761673 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.761822 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.761970 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.762127 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.762290 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.762449 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.762606 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.762754 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.762903 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.763071 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.763235 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.763392 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.763549 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.763698 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.763853 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.764015 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.764173 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.764322 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.764471 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.764620 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.764827 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.764992 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.765153 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.765308 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.765467 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.765618 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.765765 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.765929 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.766079 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.766231 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.766392 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.766603 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.766755 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.766914 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.767064 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.767232 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.767390 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.767540 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.767698 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.767847 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.767995 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.768142 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.768298 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.768446 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.768603 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.768775 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.768948 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.769558 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.770006 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.770164 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.770324 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.770474 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.770630 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.770780 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.770928 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.771086 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.771245 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.771394 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.771550 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.771706 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.771868 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.772099 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.772258 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.772406 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.772554 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.772754 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.773910 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.774096 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.774263 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.774427 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.774580 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.774738 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.774887 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.775061 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.775233 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.775395 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.775552 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.775701 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.775849 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.776009 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.776158 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.776323 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.776472 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.776669 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.776924 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.777123 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.777287 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.777435 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.777582 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.777738 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.777896 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.778045 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.778202 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.778357 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.778521 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.778669 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.778831 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.778989 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.779149 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.779404 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.779784 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.780056 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.780315 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.780471 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.780620 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.780620 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.781029 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.781191 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.781351 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.781500 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.781663 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.781823 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.781982 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.781982 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.782278 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.782427 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.782574 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.782720 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.782867 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.783024 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.783173 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.783331 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.783480 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.783635 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.783799 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.783958 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.784116 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.784272 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.784422 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.784569 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.784748 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.784903 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.785051 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.785217 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.785377 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.785535 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.785695 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.785863 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.786019 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.786019 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.786301 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.786458 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.786622 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.786772 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.786928 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.787077 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.787224 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.787379 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.787541 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.787709 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.787858 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.788004 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.788862 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.789044 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.789196 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.789344 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.789889 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.790090 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.790468 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.790632 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.790793 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.790944 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.791107 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.791271 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.791422 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.791577 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.791737 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.791894 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.792058 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.792208 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.792396 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.792552 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.792709 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.792929 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.793093 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.793093 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.793399 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.793550 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.793698 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.793847 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.794010 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.794160 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.794308 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.794455 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.794603 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.794752 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.794910 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.795069 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.795069 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.795369 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.795519 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.795681 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.795830 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.795830 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.795830 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.795830 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.795830 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.795830 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.796685 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.796923 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.797095 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.797254 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.797403 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.797561 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.797718 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.797875 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.798025 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.798181 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.798337 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.798499 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.798648 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.798796 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.798944 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.799111 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.799277 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.799426 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.799602 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.799602 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.800312 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.800763 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.800940 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.801090 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.801239 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.801395 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.801552 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.801702 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.801872 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.802030 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.802185 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.802333 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.802490 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.802646 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.802809 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.802959 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.806178 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.806370 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.806535 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.807539 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.807735 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.807902 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.808190 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.808361 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.808550 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.808736 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.809083 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.809255 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.809408 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.809605 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.809763 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.809960 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.810147 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.810311 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.810461 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.810649 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.810830 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.813374 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.813649 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.813836 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.813995 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.814302 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.814479 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.814641 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.814803 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.815026 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.815210 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.815372 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.815536 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.815536 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.815829 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.815829 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.815829 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.816300 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.816433 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.816546 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.816665 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.816800 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.816933 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.816933 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.817238 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.817372 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.817499 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.818379 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.818529 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.818676 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.818805 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.818932 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.819061 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.819187 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.819314 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.819452 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.819580 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.819707 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.819833 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.819958 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.820094 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.820235 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.820235 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.820855 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.821001 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.821162 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.822370 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.822558 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.822702 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.822831 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.822959 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.823087 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.823247 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.823411 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.823541 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.823699 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.823835 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.823964 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.824101 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.824231 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.824373 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.824512 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.824688 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.824920 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.825052 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.825190 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.825322 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.825511 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.825935 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.826096 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.826230 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.826368 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.826510 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.826671 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.826816 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.826953 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.827089 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.827089 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.827330 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.827465 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.827607 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.827743 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.827879 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.828017 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.828152 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.828289 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.828433 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.828570 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.828697 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.828843 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.829088 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.829233 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.829233 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.829233 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.829233 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.829233 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.829233 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.829233 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.829233 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.830196 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.830196 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.830196 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.830196 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.830196 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.830196 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.830196 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.830196 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.831166 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.831166 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.831166 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.831166 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.831166 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.831166 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.832367 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.832510 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.832648 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.832648 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.832973 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.833107 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.833332 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.833461 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.833587 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.833713 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.833840 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.833972 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.834109 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.834227 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.834361 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.834495 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.834629 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.834799 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.834944 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.835080 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.835220 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.835355 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.835355 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.835611 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.835749 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.835749 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.836241 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.836241 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.836499 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.836636 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.836636 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.836636 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.837029 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.837156 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.837282 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.837422 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.837551 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.837677 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.837811 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.837811 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.838069 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.838206 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.838206 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.838447 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.838581 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.838708 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.838878 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.838878 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.839131 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.839312 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.839444 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.839572 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.839572 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.839822 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.839959 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.840093 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.840221 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.840221 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.840470 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.840598 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.840774 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.840774 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.841032 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.841167 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.841309 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.841445 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.841585 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.841585 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.842138 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.842270 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.842411 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.842548 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.842548 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.842805 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.842963 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.842963 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.843229 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.844074 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.844237 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.844376 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.844376 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.844790 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.845003 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.845142 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.845513 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.845513 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.846591 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.846822 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.846964 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.847110 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.847110 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.847362 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.847491 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.847491 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.847747 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.847884 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.847884 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.848142 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.848269 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.848404 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.849236 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.849389 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.849520 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.849520 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.849520 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.849887 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.850261 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.850395 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.850524 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.850663 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.850790 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.850790 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.851084 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.851223 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.851479 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.851631 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.851631 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.852344 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.852494 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.852494 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.852956 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.853085 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.853211 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.853350 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.853350 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.853604 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.853730 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.853730 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.853968 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.854095 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.854230 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.854358 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.854358 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.854606 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.854733 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.854895 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.855025 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.855246 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.855384 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.855513 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.855647 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.855784 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.855919 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.855919 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.856168 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.856298 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.856298 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.856862 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.857006 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.857147 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.857284 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.857439 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.857592 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.857751 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.857897 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.858058 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.858217 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.858362 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.858362 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.858688 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.858839 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.859005 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.859188 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.859356 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.859514 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.859658 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.859800 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.859951 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.859951 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.860301 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.860446 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.860588 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.860767 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.860767 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.861068 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.861068 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.861350 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.861492 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.861633 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.861790 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.861933 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.862531 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.862531 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.862531 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.862958 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.863133 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.863291 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.863487 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.863644 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.863644 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.863914 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.864064 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.864221 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.864363 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.864516 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.864666 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.864909 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.865054 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.865214 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.865370 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.865370 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.865641 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.865782 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.865923 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.866144 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.866144 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.866477 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.866625 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.866625 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.867227 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.867377 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.867574 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.867720 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.867720 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.867999 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.868157 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.868300 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.868449 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.868449 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.868782 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.868931 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.869108 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.869108 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.869555 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.869783 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.869940 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.870096 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.870249 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.870401 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.870604 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.870761 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.870914 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.871066 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.871217 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.871359 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.871502 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.871656 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.871807 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.871959 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.871959 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.872360 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.872749 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.872900 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.873054 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.873208 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.873351 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.873492 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.873634 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.873783 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.873936 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.874170 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.874322 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.874473 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.874616 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.874765 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.874917 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.875074 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.875217 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.875402 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.875587 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.875742 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.875894 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.876056 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.876208 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.876644 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.876644 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.878777 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.878946 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.879092 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.879235 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.879377 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.879518 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.879675 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.879819 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.879974 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.880116 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.880258 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.880408 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.880559 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.880727 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.880891 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.881093 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.881250 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.881394 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.881564 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.881715 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.881903 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.882063 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.882214 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.882493 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.882955 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.883109 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.883254 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.883405 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.883405 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.883691 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.883835 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.883989 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.884132 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.884286 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.884428 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.884579 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.884797 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.884948 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.885109 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.885251 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.885409 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.885553 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.885695 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.885837 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.885987 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 12:29:56.886170 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.886170 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.886170 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.886170 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.886170 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.886170 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.886170 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.886170 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.887276 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.887276 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.887276 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.887276 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.887276 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.887276 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.887276 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.887276 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.888657 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.888657 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.888657 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.888657 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.888657 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.888657 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.888657 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.888657 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.889757 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.889757 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.889757 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.889757 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.889757 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.889757 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.889757 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.889757 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.890935 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.890935 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.890935 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.890935 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.890935 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.890935 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.890935 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.890935 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.892060 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.892060 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.892060 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.892060 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.892060 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.892060 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.892060 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.892060 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.893264 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.893264 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.893264 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.893264 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.893264 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.893264 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.893264 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.893264 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.894093 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.894093 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.894093 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.894093 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.894093 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.894093 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.894093 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.894093 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.894700 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.894700 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.894700 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.894700 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.895019 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.895241 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.895548 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.895884 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.896192 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.896501 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.896851 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.897166 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.897493 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.897874 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.898104 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.898462 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.898783 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.899142 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_db.sqlalchemy.engines [None req-9511222e-5f08-4656-a973-1bbb74e064ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 12:29:56.899377 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.899768 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.900093 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.900441 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.900845 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.901133 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.901445 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.902241 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.902627 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.903036 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.903367 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.903682 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.903992 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.904310 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.904626 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.904978 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.905290 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.905601 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.905956 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.906287 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.906613 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.906937 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.907255 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.907606 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.908086 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.908457 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.909131 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.909561 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.910018 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.910340 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.910650 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.911089 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.911410 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.911733 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.912058 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.912370 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.912680 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.913155 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.913359 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.913689 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.914002 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.914334 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.914678 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.915018 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.915346 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.915653 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.915961 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.916269 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.916564 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.916927 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.917242 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.917617 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.917929 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.918256 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.918567 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.918937 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.919232 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.919556 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.919869 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.920204 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.920514 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.920836 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.921151 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.921462 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.921773 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.922088 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.922422 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.922752 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.923060 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.923388 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.923708 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.924028 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.924347 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.924659 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.925021 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.925336 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.925652 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.925966 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.926276 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.926595 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.926914 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.927245 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.927572 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.927902 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.928231 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.928584 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.928924 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.929312 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.929748 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:29:56.929905 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 12:29:56.954063 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_db.sqlalchemy.engines [None req-96b9aa47-8ad5-4939-b6a9-2be53faa1b2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 12:29:56.982778 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.context [None req-9511222e-5f08-4656-a973-1bbb74e064ff None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b82f072f-c7c2-44f1-a3e5-64a44a75f91b(cell1) {{(pid=115876) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 12:29:56.987367 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9511222e-5f08-4656-a973-1bbb74e064ff None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:29:56.989017 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9511222e-5f08-4656-a973-1bbb74e064ff None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:29:56.989844 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9511222e-5f08-4656-a973-1bbb74e064ff None None] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:29:56.991811 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9511222e-5f08-4656-a973-1bbb74e064ff None None] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:29:57.003212 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_db.sqlalchemy.engines [None req-9511222e-5f08-4656-a973-1bbb74e064ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 12:29:57.004871 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_db.sqlalchemy.engines [None req-9511222e-5f08-4656-a973-1bbb74e064ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 12:29:57.037247 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.context [None req-96b9aa47-8ad5-4939-b6a9-2be53faa1b2f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b82f072f-c7c2-44f1-a3e5-64a44a75f91b(cell1) {{(pid=115877) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 12:29:57.041996 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-96b9aa47-8ad5-4939-b6a9-2be53faa1b2f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:29:57.043667 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-96b9aa47-8ad5-4939-b6a9-2be53faa1b2f None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:29:57.044521 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-96b9aa47-8ad5-4939-b6a9-2be53faa1b2f None None] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:29:57.046517 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-96b9aa47-8ad5-4939-b6a9-2be53faa1b2f None None] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:29:57.058710 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_db.sqlalchemy.engines [None req-96b9aa47-8ad5-4939-b6a9-2be53faa1b2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 12:29:57.059560 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_db.sqlalchemy.engines [None req-96b9aa47-8ad5-4939-b6a9-2be53faa1b2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 12:29:57.269084 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_db.sqlalchemy.engines [None req-9511222e-5f08-4656-a973-1bbb74e064ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 12:29:57.323770 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_db.sqlalchemy.engines [None req-96b9aa47-8ad5-4939-b6a9-2be53faa1b2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 12:29:57.593674 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: WARNING keystonemiddleware.auth_token [None req-9511222e-5f08-4656-a973-1bbb74e064ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 12:29:57.600537 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: WARNING keystonemiddleware.auth_token [None req-9511222e-5f08-4656-a973-1bbb74e064ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 12:29:57.649479 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: WARNING keystonemiddleware.auth_token [None req-96b9aa47-8ad5-4939-b6a9-2be53faa1b2f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 12:29:57.656483 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: WARNING keystonemiddleware.auth_token [None req-96b9aa47-8ad5-4939-b6a9-2be53faa1b2f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 12:29:57.958544 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: WARNING keystonemiddleware.auth_token [None req-9511222e-5f08-4656-a973-1bbb74e064ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 12:29:57.966187 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: WARNING keystonemiddleware.auth_token [None req-9511222e-5f08-4656-a973-1bbb74e064ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 12:29:57.971426 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c053ec49c0 pid: 115876 (default app) Oct 28 12:29:58.021285 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: WARNING keystonemiddleware.auth_token [None req-96b9aa47-8ad5-4939-b6a9-2be53faa1b2f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 12:29:58.026967 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: WARNING keystonemiddleware.auth_token [None req-96b9aa47-8ad5-4939-b6a9-2be53faa1b2f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 12:29:58.032375 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c053ec49c0 pid: 115877 (default app) Oct 28 12:30:32.262971 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-8b927458-d08b-4a1d-9fdd-0df0499d7d4e tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] Action: 'create', calling method: .version_select at 0x7f4a7b357f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-392181497"}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:30:32.614140 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-c42f36f6-8d79-44f0-9826-0b6199e6f6f0 tempest-VolumesGetTestJSON-1129943875 tempest-VolumesGetTestJSON-1129943875-project] Action: 'create', calling method: .version_select at 0x7f4a7b357f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-441811487", "metadata": {"Type": "work"}}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:30:34.427513 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-8b927458-d08b-4a1d-9fdd-0df0499d7d4e tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.570572 Oct 28 12:30:34.428461 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 1/1] 10.222.0.62 () {60 vars in 1154 bytes} [Thu Oct 28 12:30:30 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 3573 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 28 12:30:34.778795 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-c42f36f6-8d79-44f0-9826-0b6199e6f6f0 tempest-VolumesGetTestJSON-1129943875 tempest-VolumesGetTestJSON-1129943875-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.374892 Oct 28 12:30:34.789205 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 1/2] 10.222.0.62 () {60 vars in 1155 bytes} [Thu Oct 28 12:30:31 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 3387 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 28 12:30:34.801025 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-77107120-b417-49c4-8225-26fd66ee7f55 tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] Calling method '.version_select at 0x7f4a7b233af0>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:34.939034 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-feeefdab-bebf-4c5e-8acf-6d9afb87d270 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-269694288", "imageRef": "575f28c8-0af2-4973-b3d9-a249e2400c6e", "flavorRef": "452", "networks": [{"uuid": "77d7bc7e-f170-4994-9d38-e2a218ea13c3"}]}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:30:34.971272 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-77107120-b417-49c4-8225-26fd66ee7f55 tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/6c29e549-2309-445b-90c8-648f16a45249" status: 200 len: 345 microversion: 2.1 time: 0.180402 Oct 28 12:30:34.971873 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 2/3] 10.222.0.62 () {58 vars in 1244 bytes} [Thu Oct 28 12:30:34 2021] GET /compute/v2.1/os-volumes/6c29e549-2309-445b-90c8-648f16a45249 => generated 345 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:30:34.976580 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-4082f58a-57ef-4afa-b4fe-cde91ad14969 tempest-VolumesGetTestJSON-1129943875 tempest-VolumesGetTestJSON-1129943875-project] Calling method '.version_select at 0x7f4a7b233e50>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:35.082832 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-4082f58a-57ef-4afa-b4fe-cde91ad14969 tempest-VolumesGetTestJSON-1129943875 tempest-VolumesGetTestJSON-1129943875-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/78c7d43f-5e2c-4d41-a39b-9a66048a224a" status: 200 len: 352 microversion: 2.1 time: 0.109783 Oct 28 12:30:35.083605 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 3/4] 10.222.0.62 () {58 vars in 1244 bytes} [Thu Oct 28 12:30:34 2021] GET /compute/v2.1/os-volumes/78c7d43f-5e2c-4d41-a39b-9a66048a224a => generated 352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:30:35.089874 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-553c20ab-e7e6-4903-b682-0d1d0ad6aef1 tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] Action: 'create', calling method: .version_select at 0x7f4a7b245550>, body: {"snapshot": {"volume_id": "6c29e549-2309-445b-90c8-648f16a45249", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1560578931"}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:30:35.206179 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.network.neutron [None req-feeefdab-bebf-4c5e-8acf-6d9afb87d270 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] validate_networks() for [('77d7bc7e-f170-4994-9d38-e2a218ea13c3', None, None, None, None, None)] {{(pid=115876) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:30:35.468603 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-553c20ab-e7e6-4903-b682-0d1d0ad6aef1 tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] 10.222.0.62 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.383771 Oct 28 12:30:35.469884 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 4/5] 10.222.0.62 () {60 vars in 1161 bytes} [Thu Oct 28 12:30:35 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:30:35.483205 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-c6d7cbf9-bd6a-4092-86cd-f5cb3791769b tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] Calling method '.version_select at 0x7f4a7b24f160>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:35.681875 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-c6d7cbf9-bd6a-4092-86cd-f5cb3791769b tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/b95c7e22-0858-4560-b10c-a4623221d7d0" status: 200 len: 287 microversion: 2.1 time: 0.157349 Oct 28 12:30:35.681875 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 5/6] 10.222.0.62 () {58 vars in 1250 bytes} [Thu Oct 28 12:30:35 2021] GET /compute/v2.1/os-snapshots/b95c7e22-0858-4560-b10c-a4623221d7d0 => generated 287 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:30:35.681875 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-8e0271cf-38bd-46d1-8d65-24c22f772d48 tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] Calling method '.version_select at 0x7f4a7b233b80>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:35.742842 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-8e0271cf-38bd-46d1-8d65-24c22f772d48 tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.098683 Oct 28 12:30:35.745500 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 6/7] 10.222.0.62 () {58 vars in 1139 bytes} [Thu Oct 28 12:30:35 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:30:35.757095 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-bf8a26a4-540a-43da-83ec-30a8ba0d8e81 tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] Calling method '.version_select at 0x7f4a7b24fc10>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:35.795866 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-bf8a26a4-540a-43da-83ec-30a8ba0d8e81 tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/b95c7e22-0858-4560-b10c-a4623221d7d0" status: 200 len: 287 microversion: 2.1 time: 0.043640 Oct 28 12:30:35.797137 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 7/8] 10.222.0.62 () {58 vars in 1250 bytes} [Thu Oct 28 12:30:35 2021] GET /compute/v2.1/os-snapshots/b95c7e22-0858-4560-b10c-a4623221d7d0 => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:30:36.097177 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-141af344-f15a-46f6-b69a-037de82455d3 tempest-VolumesGetTestJSON-1129943875 tempest-VolumesGetTestJSON-1129943875-project] Calling method '.version_select at 0x7f4a7b2454c0>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:36.211419 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-141af344-f15a-46f6-b69a-037de82455d3 tempest-VolumesGetTestJSON-1129943875 tempest-VolumesGetTestJSON-1129943875-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/78c7d43f-5e2c-4d41-a39b-9a66048a224a" status: 200 len: 353 microversion: 2.1 time: 0.119043 Oct 28 12:30:36.211988 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 8/9] 10.222.0.62 () {58 vars in 1244 bytes} [Thu Oct 28 12:30:36 2021] GET /compute/v2.1/os-volumes/78c7d43f-5e2c-4d41-a39b-9a66048a224a => generated 353 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:30:36.225818 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-c5849b9d-5b8b-484d-8d54-70bbfd71c623 tempest-VolumesGetTestJSON-1129943875 tempest-VolumesGetTestJSON-1129943875-project] Calling method '.version_select at 0x7f4a7b24fc10>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:36.351599 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-c5849b9d-5b8b-484d-8d54-70bbfd71c623 tempest-VolumesGetTestJSON-1129943875 tempest-VolumesGetTestJSON-1129943875-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/78c7d43f-5e2c-4d41-a39b-9a66048a224a" status: 200 len: 353 microversion: 2.1 time: 0.129796 Oct 28 12:30:36.352183 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 9/10] 10.222.0.62 () {58 vars in 1244 bytes} [Thu Oct 28 12:30:36 2021] GET /compute/v2.1/os-volumes/78c7d43f-5e2c-4d41-a39b-9a66048a224a => generated 353 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:30:36.378901 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-c1f41b6b-2ebf-4959-b91c-70a3203b5e2c tempest-VolumesGetTestJSON-1129943875 tempest-VolumesGetTestJSON-1129943875-project] Calling method '.version_select at 0x7f4a7b24f8b0>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:36.511825 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-c1f41b6b-2ebf-4959-b91c-70a3203b5e2c tempest-VolumesGetTestJSON-1129943875 tempest-VolumesGetTestJSON-1129943875-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/78c7d43f-5e2c-4d41-a39b-9a66048a224a" status: 202 len: 0 microversion: 2.1 time: 0.141712 Oct 28 12:30:36.512565 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 10/11] 10.222.0.62 () {58 vars in 1247 bytes} [Thu Oct 28 12:30:36 2021] DELETE /compute/v2.1/os-volumes/78c7d43f-5e2c-4d41-a39b-9a66048a224a => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:30:36.520681 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-86d11b8a-a2c4-4db3-be74-c9ee7b22d850 tempest-VolumesGetTestJSON-1129943875 tempest-VolumesGetTestJSON-1129943875-project] Calling method '.version_select at 0x7f4a7bbc73a0>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:36.621705 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-86d11b8a-a2c4-4db3-be74-c9ee7b22d850 tempest-VolumesGetTestJSON-1129943875 tempest-VolumesGetTestJSON-1129943875-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/78c7d43f-5e2c-4d41-a39b-9a66048a224a" status: 200 len: 352 microversion: 2.1 time: 0.104860 Oct 28 12:30:36.622265 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 11/12] 10.222.0.62 () {58 vars in 1244 bytes} [Thu Oct 28 12:30:36 2021] GET /compute/v2.1/os-volumes/78c7d43f-5e2c-4d41-a39b-9a66048a224a => generated 352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:30:36.808916 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-e006f361-d9e1-4833-98b7-a90466020532 tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] Calling method '.version_select at 0x7f4a7b233d30>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:36.865336 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-e006f361-d9e1-4833-98b7-a90466020532 tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/b95c7e22-0858-4560-b10c-a4623221d7d0" status: 200 len: 287 microversion: 2.1 time: 0.060704 Oct 28 12:30:36.866170 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 12/13] 10.222.0.62 () {58 vars in 1250 bytes} [Thu Oct 28 12:30:36 2021] GET /compute/v2.1/os-snapshots/b95c7e22-0858-4560-b10c-a4623221d7d0 => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:30:37.055217 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-feeefdab-bebf-4c5e-8acf-6d9afb87d270 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Flavor limits 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:30:37.056064 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-feeefdab-bebf-4c5e-8acf-6d9afb87d270 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Image limits 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:30:37.056203 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-feeefdab-bebf-4c5e-8acf-6d9afb87d270 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Flavor pref 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:30:37.056486 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-feeefdab-bebf-4c5e-8acf-6d9afb87d270 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Image pref 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:30:37.057161 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-feeefdab-bebf-4c5e-8acf-6d9afb87d270 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:30:37.086879 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-feeefdab-bebf-4c5e-8acf-6d9afb87d270 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:30:37.087811 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-feeefdab-bebf-4c5e-8acf-6d9afb87d270 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:30:37.090164 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-feeefdab-bebf-4c5e-8acf-6d9afb87d270 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:30:37.091029 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-feeefdab-bebf-4c5e-8acf-6d9afb87d270 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:30:37.145625 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-feeefdab-bebf-4c5e-8acf-6d9afb87d270 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Getting quotas for project 784e1090f5bd4ef6bb01c960b5b89226. Resources: {'cores', 'instances', 'ram'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:30:37.156576 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-feeefdab-bebf-4c5e-8acf-6d9afb87d270 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Getting quotas for user 848238e66f2e42de8eb36126ed103602 and project 784e1090f5bd4ef6bb01c960b5b89226. Resources: {'cores', 'instances', 'ram'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:30:37.179903 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-feeefdab-bebf-4c5e-8acf-6d9afb87d270 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Going to run 1 instances... {{(pid=115876) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:30:37.183563 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-feeefdab-bebf-4c5e-8acf-6d9afb87d270 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] [instance: 3e3afd4f-1acd-48ae-af4c-1e8d190dd313] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='575f28c8-0af2-4973-b3d9-a249e2400c6e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:30:37.314652 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-feeefdab-bebf-4c5e-8acf-6d9afb87d270 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.876758 Oct 28 12:30:37.315621 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 2/14] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Oct 28 12:30:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 2887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 12:30:37.326080 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-36b2e234-a557-447e-ad4f-23c3d6847017 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:37.326959 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-36b2e234-a557-447e-ad4f-23c3d6847017 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] [instance: 3e3afd4f-1acd-48ae-af4c-1e8d190dd313] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:30:37.449489 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-36b2e234-a557-447e-ad4f-23c3d6847017 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848238e66f2e42de8eb36126ed103602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e1090f5bd4ef6bb01c960b5b89226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:30:37.480115 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-36b2e234-a557-447e-ad4f-23c3d6847017 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313" status: 200 len: 1214 microversion: 2.1 time: 0.158056 Oct 28 12:30:37.480623 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 13/15] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:30:37 2021] GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313 => generated 1214 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:30:37.637530 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-88958c5c-056e-46cd-91a2-9c017d2832d3 tempest-VolumesGetTestJSON-1129943875 tempest-VolumesGetTestJSON-1129943875-project] Calling method '.version_select at 0x7f4a7b14c280>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:37.737399 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-88958c5c-056e-46cd-91a2-9c017d2832d3 tempest-VolumesGetTestJSON-1129943875 tempest-VolumesGetTestJSON-1129943875-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/78c7d43f-5e2c-4d41-a39b-9a66048a224a" status: 200 len: 352 microversion: 2.1 time: 0.105178 Oct 28 12:30:37.740872 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 3/16] 10.222.0.62 () {58 vars in 1244 bytes} [Thu Oct 28 12:30:37 2021] GET /compute/v2.1/os-volumes/78c7d43f-5e2c-4d41-a39b-9a66048a224a => generated 352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:30:37.887153 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-a79d94a5-41e5-40ec-83e0-7f6016685131 tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] Calling method '.version_select at 0x7f4a7bbc75e0>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:37.961709 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-a79d94a5-41e5-40ec-83e0-7f6016685131 tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/b95c7e22-0858-4560-b10c-a4623221d7d0" status: 200 len: 287 microversion: 2.1 time: 0.087674 Oct 28 12:30:37.962984 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 14/17] 10.222.0.62 () {58 vars in 1250 bytes} [Thu Oct 28 12:30:37 2021] GET /compute/v2.1/os-snapshots/b95c7e22-0858-4560-b10c-a4623221d7d0 => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:30:38.502495 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-0762d03e-2ac5-42f9-b800-5aef14261d9b tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:38.503282 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-0762d03e-2ac5-42f9-b800-5aef14261d9b tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] [instance: 3e3afd4f-1acd-48ae-af4c-1e8d190dd313] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:30:38.679441 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-0762d03e-2ac5-42f9-b800-5aef14261d9b tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848238e66f2e42de8eb36126ed103602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e1090f5bd4ef6bb01c960b5b89226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:30:38.704964 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-0762d03e-2ac5-42f9-b800-5aef14261d9b tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313" status: 200 len: 1214 microversion: 2.1 time: 0.211135 Oct 28 12:30:38.705695 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 4/18] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:30:38 2021] GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313 => generated 1214 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:30:38.753707 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-cd86cde9-9a58-40ae-af92-9fcfd81e4548 tempest-VolumesGetTestJSON-1129943875 tempest-VolumesGetTestJSON-1129943875-project] Calling method '.version_select at 0x7f4a7b211940>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:38.849625 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-cd86cde9-9a58-40ae-af92-9fcfd81e4548 tempest-VolumesGetTestJSON-1129943875 tempest-VolumesGetTestJSON-1129943875-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/78c7d43f-5e2c-4d41-a39b-9a66048a224a" status: 200 len: 352 microversion: 2.1 time: 0.100776 Oct 28 12:30:38.851512 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 15/19] 10.222.0.62 () {58 vars in 1244 bytes} [Thu Oct 28 12:30:38 2021] GET /compute/v2.1/os-volumes/78c7d43f-5e2c-4d41-a39b-9a66048a224a => generated 352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:30:38.976564 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-d19a8367-37a0-46c0-9a62-f0fe2d5204b7 tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] Calling method '.version_select at 0x7f4a7b14c790>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:39.043445 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-d19a8367-37a0-46c0-9a62-f0fe2d5204b7 tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/b95c7e22-0858-4560-b10c-a4623221d7d0" status: 200 len: 288 microversion: 2.1 time: 0.072175 Oct 28 12:30:39.044494 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 5/20] 10.222.0.62 () {58 vars in 1250 bytes} [Thu Oct 28 12:30:38 2021] GET /compute/v2.1/os-snapshots/b95c7e22-0858-4560-b10c-a4623221d7d0 => generated 288 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:30:39.059064 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-27d8d826-52ca-45c9-88ae-c5e3c27453eb tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] Calling method '.version_select at 0x7f4a7b212310>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:39.229193 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-27d8d826-52ca-45c9-88ae-c5e3c27453eb tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] 10.222.0.62 "DELETE /compute/v2.1/os-snapshots/b95c7e22-0858-4560-b10c-a4623221d7d0" status: 202 len: 0 microversion: 2.1 time: 0.175180 Oct 28 12:30:39.229774 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 16/21] 10.222.0.62 () {58 vars in 1253 bytes} [Thu Oct 28 12:30:39 2021] DELETE /compute/v2.1/os-snapshots/b95c7e22-0858-4560-b10c-a4623221d7d0 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:30:39.240216 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-4f730c27-34ce-4b5f-9681-80bf20a8432d tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] Calling method '.version_select at 0x7f4a7a0f9e50>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:39.309401 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-4f730c27-34ce-4b5f-9681-80bf20a8432d tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/b95c7e22-0858-4560-b10c-a4623221d7d0" status: 200 len: 287 microversion: 2.1 time: 0.074418 Oct 28 12:30:39.311188 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 6/22] 10.222.0.62 () {58 vars in 1250 bytes} [Thu Oct 28 12:30:39 2021] GET /compute/v2.1/os-snapshots/b95c7e22-0858-4560-b10c-a4623221d7d0 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:30:39.725971 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-f44e1e4c-4d8f-46b4-9b10-96040a125521 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:39.726584 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-f44e1e4c-4d8f-46b4-9b10-96040a125521 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] [instance: 3e3afd4f-1acd-48ae-af4c-1e8d190dd313] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:30:39.740606 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f44e1e4c-4d8f-46b4-9b10-96040a125521 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:30:39.741082 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f44e1e4c-4d8f-46b4-9b10-96040a125521 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:30:39.741885 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f44e1e4c-4d8f-46b4-9b10-96040a125521 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:30:39.742315 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f44e1e4c-4d8f-46b4-9b10-96040a125521 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:30:39.864862 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-c4d8acd4-53d9-46f9-9547-6fa7f59330e2 tempest-VolumesGetTestJSON-1129943875 tempest-VolumesGetTestJSON-1129943875-project] Calling method '.version_select at 0x7f4a7a111790>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:39.919135 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.wsgi [None req-c4d8acd4-53d9-46f9-9547-6fa7f59330e2 tempest-VolumesGetTestJSON-1129943875 tempest-VolumesGetTestJSON-1129943875-project] HTTP exception thrown: Volume 78c7d43f-5e2c-4d41-a39b-9a66048a224a could not be found. Oct 28 12:30:39.919743 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-c4d8acd4-53d9-46f9-9547-6fa7f59330e2 tempest-VolumesGetTestJSON-1129943875 tempest-VolumesGetTestJSON-1129943875-project] Returning 404 to user: Volume 78c7d43f-5e2c-4d41-a39b-9a66048a224a could not be found. {{(pid=115876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:30:39.920647 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-c4d8acd4-53d9-46f9-9547-6fa7f59330e2 tempest-VolumesGetTestJSON-1129943875 tempest-VolumesGetTestJSON-1129943875-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/78c7d43f-5e2c-4d41-a39b-9a66048a224a" status: 404 len: 109 microversion: 2.1 time: 0.060984 Oct 28 12:30:39.922070 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 7/23] 10.222.0.62 () {58 vars in 1244 bytes} [Thu Oct 28 12:30:39 2021] GET /compute/v2.1/os-volumes/78c7d43f-5e2c-4d41-a39b-9a66048a224a => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:30:40.085351 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-f44e1e4c-4d8f-46b4-9b10-96040a125521 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848238e66f2e42de8eb36126ed103602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e1090f5bd4ef6bb01c960b5b89226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:30:40.171730 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-f44e1e4c-4d8f-46b4-9b10-96040a125521 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313" status: 200 len: 1266 microversion: 2.1 time: 0.425063 Oct 28 12:30:40.172985 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 17/24] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:30:39 2021] GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313 => generated 1266 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:30:40.325390 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-af7fda92-c267-4f43-89fb-78e2fcdb9fd1 tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] Calling method '.version_select at 0x7f4a7a1119d0>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:40.381825 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.wsgi [None req-af7fda92-c267-4f43-89fb-78e2fcdb9fd1 tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] HTTP exception thrown: Snapshot b95c7e22-0858-4560-b10c-a4623221d7d0 could not be found. Oct 28 12:30:40.382755 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-af7fda92-c267-4f43-89fb-78e2fcdb9fd1 tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] Returning 404 to user: Snapshot b95c7e22-0858-4560-b10c-a4623221d7d0 could not be found. {{(pid=115876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:30:40.383789 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-af7fda92-c267-4f43-89fb-78e2fcdb9fd1 tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/b95c7e22-0858-4560-b10c-a4623221d7d0" status: 404 len: 111 microversion: 2.1 time: 0.065430 Oct 28 12:30:40.384924 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 8/25] 10.222.0.62 () {58 vars in 1250 bytes} [Thu Oct 28 12:30:40 2021] GET /compute/v2.1/os-snapshots/b95c7e22-0858-4560-b10c-a4623221d7d0 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:30:40.393444 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-d73af853-dfa1-484b-a964-bd5a953f141d tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] Calling method '.version_select at 0x7f4a7b11d160>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:40.604052 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-d73af853-dfa1-484b-a964-bd5a953f141d tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/6c29e549-2309-445b-90c8-648f16a45249" status: 202 len: 0 microversion: 2.1 time: 0.214190 Oct 28 12:30:40.604974 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 18/26] 10.222.0.62 () {58 vars in 1247 bytes} [Thu Oct 28 12:30:40 2021] DELETE /compute/v2.1/os-volumes/6c29e549-2309-445b-90c8-648f16a45249 => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:30:40.614206 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-faad0310-ab25-41ad-8cbe-a313d8ee0385 tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] Calling method '.version_select at 0x7f4a7a111280>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:40.691611 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-faad0310-ab25-41ad-8cbe-a313d8ee0385 tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/6c29e549-2309-445b-90c8-648f16a45249" status: 200 len: 344 microversion: 2.1 time: 0.082657 Oct 28 12:30:40.692699 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 9/27] 10.222.0.62 () {58 vars in 1244 bytes} [Thu Oct 28 12:30:40 2021] GET /compute/v2.1/os-volumes/6c29e549-2309-445b-90c8-648f16a45249 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:30:41.189560 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-3c8717f6-1876-4d3d-941f-fd136f4c674e tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:41.190842 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-3c8717f6-1876-4d3d-941f-fd136f4c674e tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] [instance: 3e3afd4f-1acd-48ae-af4c-1e8d190dd313] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:30:41.202810 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3c8717f6-1876-4d3d-941f-fd136f4c674e tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:30:41.203268 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3c8717f6-1876-4d3d-941f-fd136f4c674e tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:30:41.204321 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3c8717f6-1876-4d3d-941f-fd136f4c674e tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:30:41.204787 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3c8717f6-1876-4d3d-941f-fd136f4c674e tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:30:41.336420 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-3c8717f6-1876-4d3d-941f-fd136f4c674e tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848238e66f2e42de8eb36126ed103602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e1090f5bd4ef6bb01c960b5b89226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:30:41.349453 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-3c8717f6-1876-4d3d-941f-fd136f4c674e tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313" status: 200 len: 1272 microversion: 2.1 time: 0.163321 Oct 28 12:30:41.351168 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 19/28] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:30:41 2021] GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313 => generated 1272 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:30:41.705324 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-d9f628cd-254f-47ad-9ef6-aad80c774e7a tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] Calling method '.version_select at 0x7f4a7a0f9ee0>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:41.750055 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.wsgi [None req-d9f628cd-254f-47ad-9ef6-aad80c774e7a tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] HTTP exception thrown: Volume 6c29e549-2309-445b-90c8-648f16a45249 could not be found. Oct 28 12:30:41.750753 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-d9f628cd-254f-47ad-9ef6-aad80c774e7a tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] Returning 404 to user: Volume 6c29e549-2309-445b-90c8-648f16a45249 could not be found. {{(pid=115876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:30:41.751577 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-d9f628cd-254f-47ad-9ef6-aad80c774e7a tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/6c29e549-2309-445b-90c8-648f16a45249" status: 404 len: 109 microversion: 2.1 time: 0.050630 Oct 28 12:30:41.752594 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 10/29] 10.222.0.62 () {58 vars in 1244 bytes} [Thu Oct 28 12:30:41 2021] GET /compute/v2.1/os-volumes/6c29e549-2309-445b-90c8-648f16a45249 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:30:41.761584 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-937a220c-ceb9-4e31-8c2e-518b5a420b1f tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] Calling method '.version_select at 0x7f4a7b151670>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:41.814732 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.wsgi [None req-937a220c-ceb9-4e31-8c2e-518b5a420b1f tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] HTTP exception thrown: Volume 6c29e549-2309-445b-90c8-648f16a45249 could not be found. Oct 28 12:30:41.815331 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-937a220c-ceb9-4e31-8c2e-518b5a420b1f tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] Returning 404 to user: Volume 6c29e549-2309-445b-90c8-648f16a45249 could not be found. {{(pid=115877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:30:41.816948 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-937a220c-ceb9-4e31-8c2e-518b5a420b1f tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/6c29e549-2309-445b-90c8-648f16a45249" status: 404 len: 109 microversion: 2.1 time: 0.059248 Oct 28 12:30:41.818140 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 20/30] 10.222.0.62 () {58 vars in 1247 bytes} [Thu Oct 28 12:30:41 2021] DELETE /compute/v2.1/os-volumes/6c29e549-2309-445b-90c8-648f16a45249 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:30:41.826405 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-5998772c-bc45-488b-bc77-ac751d7a9d15 tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] Calling method '.version_select at 0x7f4a7bbc9670>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:41.875437 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.wsgi [None req-5998772c-bc45-488b-bc77-ac751d7a9d15 tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] HTTP exception thrown: Volume 6c29e549-2309-445b-90c8-648f16a45249 could not be found. Oct 28 12:30:41.876910 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-5998772c-bc45-488b-bc77-ac751d7a9d15 tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] Returning 404 to user: Volume 6c29e549-2309-445b-90c8-648f16a45249 could not be found. {{(pid=115876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:30:41.878618 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-5998772c-bc45-488b-bc77-ac751d7a9d15 tempest-VolumesSnapshotsTestJSON-1133955917 tempest-VolumesSnapshotsTestJSON-1133955917-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/6c29e549-2309-445b-90c8-648f16a45249" status: 404 len: 109 microversion: 2.1 time: 0.055712 Oct 28 12:30:41.883901 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 11/31] 10.222.0.62 () {58 vars in 1244 bytes} [Thu Oct 28 12:30:41 2021] GET /compute/v2.1/os-volumes/6c29e549-2309-445b-90c8-648f16a45249 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:30:42.386136 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-e3ee80e9-cd9d-4217-a13e-0cfff621d431 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:42.387313 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-e3ee80e9-cd9d-4217-a13e-0cfff621d431 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] [instance: 3e3afd4f-1acd-48ae-af4c-1e8d190dd313] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:30:42.431937 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e3ee80e9-cd9d-4217-a13e-0cfff621d431 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:30:42.441476 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e3ee80e9-cd9d-4217-a13e-0cfff621d431 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:30:42.446856 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e3ee80e9-cd9d-4217-a13e-0cfff621d431 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:30:42.451803 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e3ee80e9-cd9d-4217-a13e-0cfff621d431 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:30:42.816932 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-e3ee80e9-cd9d-4217-a13e-0cfff621d431 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848238e66f2e42de8eb36126ed103602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e1090f5bd4ef6bb01c960b5b89226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:30:42.826338 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-e3ee80e9-cd9d-4217-a13e-0cfff621d431 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313" status: 200 len: 1314 microversion: 2.1 time: 0.461414 Oct 28 12:30:42.831744 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 21/32] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:30:42 2021] GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313 => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:30:43.472333 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-c2161df3-da38-474a-aaf8-4be3e09ba23d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-871795622", "imageRef": "575f28c8-0af2-4973-b3d9-a249e2400c6e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c3a51c3-709d-44a6-8c38-864c03c3e6a4"}]}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:30:43.753860 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.network.neutron [None req-c2161df3-da38-474a-aaf8-4be3e09ba23d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] validate_networks() for [('5c3a51c3-709d-44a6-8c38-864c03c3e6a4', None, None, None, None, None)] {{(pid=115876) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:30:43.855435 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-9d23ab41-b164-4e05-8986-1f8fac277f66 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:43.856863 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-9d23ab41-b164-4e05-8986-1f8fac277f66 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] [instance: 3e3afd4f-1acd-48ae-af4c-1e8d190dd313] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:30:43.866332 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9d23ab41-b164-4e05-8986-1f8fac277f66 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:30:43.869106 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9d23ab41-b164-4e05-8986-1f8fac277f66 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:30:43.871819 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9d23ab41-b164-4e05-8986-1f8fac277f66 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:30:43.873456 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9d23ab41-b164-4e05-8986-1f8fac277f66 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:30:45.603101 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-9d23ab41-b164-4e05-8986-1f8fac277f66 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848238e66f2e42de8eb36126ed103602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e1090f5bd4ef6bb01c960b5b89226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:30:45.611849 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-9d23ab41-b164-4e05-8986-1f8fac277f66 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313" status: 200 len: 1314 microversion: 2.1 time: 1.766746 Oct 28 12:30:45.627025 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 22/33] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:30:43 2021] GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313 => generated 1314 bytes in 1782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:30:46.646605 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-40533149-8a6c-4398-b55d-97866cec4553 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:46.647230 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-40533149-8a6c-4398-b55d-97866cec4553 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] [instance: 3e3afd4f-1acd-48ae-af4c-1e8d190dd313] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:30:46.735830 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-40533149-8a6c-4398-b55d-97866cec4553 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:30:46.735830 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-40533149-8a6c-4398-b55d-97866cec4553 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:30:46.735830 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-40533149-8a6c-4398-b55d-97866cec4553 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:30:46.735830 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-40533149-8a6c-4398-b55d-97866cec4553 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:30:47.986937 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-c2161df3-da38-474a-aaf8-4be3e09ba23d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Flavor limits 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:30:47.988428 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-c2161df3-da38-474a-aaf8-4be3e09ba23d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Image limits 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:30:48.005184 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-c2161df3-da38-474a-aaf8-4be3e09ba23d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Flavor pref 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:30:48.006199 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-c2161df3-da38-474a-aaf8-4be3e09ba23d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Image pref 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:30:48.007120 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-c2161df3-da38-474a-aaf8-4be3e09ba23d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:30:48.106593 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c2161df3-da38-474a-aaf8-4be3e09ba23d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:30:48.107374 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c2161df3-da38-474a-aaf8-4be3e09ba23d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:30:48.108929 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c2161df3-da38-474a-aaf8-4be3e09ba23d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:30:48.119034 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c2161df3-da38-474a-aaf8-4be3e09ba23d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:30:48.270531 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-c2161df3-da38-474a-aaf8-4be3e09ba23d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Getting quotas for project 89341f96003c41e9be94073b0ef97275. Resources: {'cores', 'instances', 'ram'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:30:48.289803 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-c2161df3-da38-474a-aaf8-4be3e09ba23d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Getting quotas for user 3ed2a525287d4d5cbde5977afba29c9d and project 89341f96003c41e9be94073b0ef97275. Resources: {'cores', 'instances', 'ram'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:30:48.383875 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-c2161df3-da38-474a-aaf8-4be3e09ba23d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Going to run 1 instances... {{(pid=115876) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:30:48.393724 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-c2161df3-da38-474a-aaf8-4be3e09ba23d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='575f28c8-0af2-4973-b3d9-a249e2400c6e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:30:48.671757 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-c2161df3-da38-474a-aaf8-4be3e09ba23d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.517330 Oct 28 12:30:48.673325 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 12/34] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Oct 28 12:30:43 2021] POST /compute/v2.1/servers => generated 383 bytes in 5520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 12:30:48.834568 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-40533149-8a6c-4398-b55d-97866cec4553 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848238e66f2e42de8eb36126ed103602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e1090f5bd4ef6bb01c960b5b89226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:30:48.863254 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-40533149-8a6c-4398-b55d-97866cec4553 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313" status: 200 len: 1314 microversion: 2.1 time: 2.220695 Oct 28 12:30:48.875885 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 23/35] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:30:46 2021] GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313 => generated 1314 bytes in 2234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:30:48.934970 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-01bdb6dd-66a5-4131-a06b-77ec4fc23e20 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:48.945734 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-01bdb6dd-66a5-4131-a06b-77ec4fc23e20 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:30:49.702755 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-01bdb6dd-66a5-4131-a06b-77ec4fc23e20 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:30:49.714165 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-01bdb6dd-66a5-4131-a06b-77ec4fc23e20 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1221 microversion: 2.1 time: 0.836361 Oct 28 12:30:49.719410 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 24/36] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:30:48 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1221 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:30:49.797193 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-cf8d7fdf-6d72-47a8-8108-cef2cad56297 tempest-VolumesNegativeTest-1687240185 tempest-VolumesNegativeTest-1687240185-project] Action: 'create', calling method: .version_select at 0x7f4a7b14cdc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1076166891", "metadata": {"Type": "work"}}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:30:49.799431 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-cf8d7fdf-6d72-47a8-8108-cef2cad56297 tempest-VolumesNegativeTest-1687240185 tempest-VolumesNegativeTest-1687240185-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=115876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:30:49.800361 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-cf8d7fdf-6d72-47a8-8108-cef2cad56297 tempest-VolumesNegativeTest-1687240185 tempest-VolumesNegativeTest-1687240185-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.126027 Oct 28 12:30:49.801334 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 13/37] 10.222.0.62 () {60 vars in 1155 bytes} [Thu Oct 28 12:30:48 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1127 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 12:30:49.814111 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-21196c14-ede2-4b88-8fd8-206d3e6993b2 tempest-VolumesNegativeTest-1687240185 tempest-VolumesNegativeTest-1687240185-project] Action: 'create', calling method: .version_select at 0x7f4a7b0f4940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-817009041", "metadata": {"Type": "work"}}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:30:49.815650 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-21196c14-ede2-4b88-8fd8-206d3e6993b2 tempest-VolumesNegativeTest-1687240185 tempest-VolumesNegativeTest-1687240185-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=115877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:30:49.816473 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-21196c14-ede2-4b88-8fd8-206d3e6993b2 tempest-VolumesNegativeTest-1687240185 tempest-VolumesNegativeTest-1687240185-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007362 Oct 28 12:30:49.817047 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 25/38] 10.222.0.62 () {60 vars in 1155 bytes} [Thu Oct 28 12:30:49 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 12:30:49.826589 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-eb80ac2e-4274-4382-a0d7-9552ae4586b9 tempest-VolumesNegativeTest-1687240185 tempest-VolumesNegativeTest-1687240185-project] Action: 'create', calling method: .version_select at 0x7f4a7a111940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1655909677", "metadata": {"Type": "work"}}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:30:49.828615 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-eb80ac2e-4274-4382-a0d7-9552ae4586b9 tempest-VolumesNegativeTest-1687240185 tempest-VolumesNegativeTest-1687240185-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=115876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:30:49.840780 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-eb80ac2e-4274-4382-a0d7-9552ae4586b9 tempest-VolumesNegativeTest-1687240185 tempest-VolumesNegativeTest-1687240185-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017474 Oct 28 12:30:49.843935 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 14/39] 10.222.0.62 () {60 vars in 1155 bytes} [Thu Oct 28 12:30:49 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 12:30:49.855955 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-f53030f3-ed14-4322-a8d4-92307fb80d59 tempest-VolumesNegativeTest-1687240185 tempest-VolumesNegativeTest-1687240185-project] Calling method '.version_select at 0x7f4a7b0ea160>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:49.884159 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-d1c42ede-3922-4228-8e87-2979fb072592 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:49.884867 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-d1c42ede-3922-4228-8e87-2979fb072592 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] [instance: 3e3afd4f-1acd-48ae-af4c-1e8d190dd313] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:30:49.929735 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d1c42ede-3922-4228-8e87-2979fb072592 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:30:49.936354 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d1c42ede-3922-4228-8e87-2979fb072592 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:30:49.937648 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d1c42ede-3922-4228-8e87-2979fb072592 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:30:49.948478 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d1c42ede-3922-4228-8e87-2979fb072592 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:30:49.991272 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.wsgi [None req-f53030f3-ed14-4322-a8d4-92307fb80d59 tempest-VolumesNegativeTest-1687240185 tempest-VolumesNegativeTest-1687240185-project] HTTP exception thrown: Volume tempest-invalid-1236667673 could not be found. Oct 28 12:30:49.991872 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-f53030f3-ed14-4322-a8d4-92307fb80d59 tempest-VolumesNegativeTest-1687240185 tempest-VolumesNegativeTest-1687240185-project] Returning 404 to user: Volume tempest-invalid-1236667673 could not be found. {{(pid=115877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:30:49.992697 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-f53030f3-ed14-4322-a8d4-92307fb80d59 tempest-VolumesNegativeTest-1687240185 tempest-VolumesNegativeTest-1687240185-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1236667673" status: 404 len: 99 microversion: 2.1 time: 0.141887 Oct 28 12:30:49.993635 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 26/40] 10.222.0.62 () {58 vars in 1217 bytes} [Thu Oct 28 12:30:49 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1236667673 => generated 99 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 12:30:50.002205 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-a696f084-30b4-4cb0-a50e-2e487fd84abf tempest-VolumesNegativeTest-1687240185 tempest-VolumesNegativeTest-1687240185-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003587 Oct 28 12:30:50.002726 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 27/41] 10.222.0.62 () {58 vars in 1139 bytes} [Thu Oct 28 12:30:49 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 28 12:30:50.011835 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-4f7ff720-2de0-453f-9baa-234fb0b4087a tempest-VolumesNegativeTest-1687240185 tempest-VolumesNegativeTest-1687240185-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003694 Oct 28 12:30:50.036238 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 28/42] 10.222.0.62 () {58 vars in 1136 bytes} [Thu Oct 28 12:30:50 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 28 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 12:30:50.063611 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-4fbf1a94-045d-4d41-859c-4fc3fb4f888d tempest-VolumesNegativeTest-1687240185 tempest-VolumesNegativeTest-1687240185-project] Calling method '.version_select at 0x7f4a7b0feca0>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:50.170862 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.wsgi [None req-4fbf1a94-045d-4d41-859c-4fc3fb4f888d tempest-VolumesNegativeTest-1687240185 tempest-VolumesNegativeTest-1687240185-project] HTTP exception thrown: Volume a7cfab28-6d5f-4711-8ab7-5657e038cf84 could not be found. Oct 28 12:30:50.171455 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-4fbf1a94-045d-4d41-859c-4fc3fb4f888d tempest-VolumesNegativeTest-1687240185 tempest-VolumesNegativeTest-1687240185-project] Returning 404 to user: Volume a7cfab28-6d5f-4711-8ab7-5657e038cf84 could not be found. {{(pid=115877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:30:50.172284 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-4fbf1a94-045d-4d41-859c-4fc3fb4f888d tempest-VolumesNegativeTest-1687240185 tempest-VolumesNegativeTest-1687240185-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/a7cfab28-6d5f-4711-8ab7-5657e038cf84" status: 404 len: 109 microversion: 2.1 time: 0.134991 Oct 28 12:30:50.173123 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 29/43] 10.222.0.62 () {58 vars in 1247 bytes} [Thu Oct 28 12:30:50 2021] DELETE /compute/v2.1/os-volumes/a7cfab28-6d5f-4711-8ab7-5657e038cf84 => generated 109 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:30:50.182820 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-b9863f4c-2c16-4f24-affa-633e2526ac70 tempest-VolumesNegativeTest-1687240185 tempest-VolumesNegativeTest-1687240185-project] Calling method '.version_select at 0x7f4a7b11d160>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:50.263849 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.wsgi [None req-b9863f4c-2c16-4f24-affa-633e2526ac70 tempest-VolumesNegativeTest-1687240185 tempest-VolumesNegativeTest-1687240185-project] HTTP exception thrown: Volume 8300ada7-76e3-49da-a91e-5018143e2afe could not be found. Oct 28 12:30:50.264823 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-b9863f4c-2c16-4f24-affa-633e2526ac70 tempest-VolumesNegativeTest-1687240185 tempest-VolumesNegativeTest-1687240185-project] Returning 404 to user: Volume 8300ada7-76e3-49da-a91e-5018143e2afe could not be found. {{(pid=115877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:30:50.265795 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-b9863f4c-2c16-4f24-affa-633e2526ac70 tempest-VolumesNegativeTest-1687240185 tempest-VolumesNegativeTest-1687240185-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/8300ada7-76e3-49da-a91e-5018143e2afe" status: 404 len: 109 microversion: 2.1 time: 0.086779 Oct 28 12:30:50.266779 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 30/44] 10.222.0.62 () {58 vars in 1244 bytes} [Thu Oct 28 12:30:50 2021] GET /compute/v2.1/os-volumes/8300ada7-76e3-49da-a91e-5018143e2afe => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:30:50.636189 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-0f72c51e-d543-4545-909a-a43334ed8ddf tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1641838440", "imageRef": "575f28c8-0af2-4973-b3d9-a249e2400c6e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c3a51c3-709d-44a6-8c38-864c03c3e6a4"}]}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:30:51.029497 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.network.neutron [None req-0f72c51e-d543-4545-909a-a43334ed8ddf tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] validate_networks() for [('5c3a51c3-709d-44a6-8c38-864c03c3e6a4', None, None, None, None, None)] {{(pid=115877) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:30:52.160332 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-d1c42ede-3922-4228-8e87-2979fb072592 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848238e66f2e42de8eb36126ed103602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e1090f5bd4ef6bb01c960b5b89226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:30:52.180524 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-d1c42ede-3922-4228-8e87-2979fb072592 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313" status: 200 len: 1314 microversion: 2.1 time: 2.301865 Oct 28 12:30:52.183405 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 15/45] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:30:49 2021] GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313 => generated 1314 bytes in 2305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:30:52.407309 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-58536374-30b3-4724-9b68-70fcd22ffd37 req-0c6bd9d8-9f67-4f9c-b5af-198987c54c69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e3afd4f-1acd-48ae-af4c-1e8d190dd313", "tag": "6b8de827-c643-404c-86f6-5c0f33960730"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:30:52.410878 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:30:52.410878 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:30:52.451601 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-58536374-30b3-4724-9b68-70fcd22ffd37 req-0c6bd9d8-9f67-4f9c-b5af-198987c54c69 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:30:52.452090 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-58536374-30b3-4724-9b68-70fcd22ffd37 req-0c6bd9d8-9f67-4f9c-b5af-198987c54c69 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:30:52.482423 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-58536374-30b3-4724-9b68-70fcd22ffd37 req-0c6bd9d8-9f67-4f9c-b5af-198987c54c69 service nova] Creating event network-changed:6b8de827-c643-404c-86f6-5c0f33960730 for instance 3e3afd4f-1acd-48ae-af4c-1e8d190dd313 on hv-cinder-81514 Oct 28 12:30:52.484397 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-58536374-30b3-4724-9b68-70fcd22ffd37 req-0c6bd9d8-9f67-4f9c-b5af-198987c54c69 service nova] Acquired lock "compute-rpcapi-router" {{(pid=115876) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Oct 28 12:30:52.486701 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1cd94fb2-cd3f-47be-974b-ec04261e769e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:30:52.487523 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1cd94fb2-cd3f-47be-974b-ec04261e769e None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:30:52.488922 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1cd94fb2-cd3f-47be-974b-ec04261e769e None None] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:30:52.489658 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1cd94fb2-cd3f-47be-974b-ec04261e769e None None] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:30:52.500922 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.compute.rpcapi [None req-1cd94fb2-cd3f-47be-974b-ec04261e769e None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Oct 28 12:30:52.502254 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1cd94fb2-cd3f-47be-974b-ec04261e769e None None] Releasing lock "compute-rpcapi-router" {{(pid=115876) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Oct 28 12:30:52.559731 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-1cd94fb2-cd3f-47be-974b-ec04261e769e None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.374885 Oct 28 12:30:52.561155 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 16/46] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:30:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:30:53.203709 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-e64234a9-575a-48da-aab3-085a73abbc78 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:53.206032 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-e64234a9-575a-48da-aab3-085a73abbc78 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] [instance: 3e3afd4f-1acd-48ae-af4c-1e8d190dd313] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:30:53.220637 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e64234a9-575a-48da-aab3-085a73abbc78 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:30:53.223595 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e64234a9-575a-48da-aab3-085a73abbc78 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:30:53.224495 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e64234a9-575a-48da-aab3-085a73abbc78 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:30:53.226670 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e64234a9-575a-48da-aab3-085a73abbc78 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:30:54.484402 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-e64234a9-575a-48da-aab3-085a73abbc78 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848238e66f2e42de8eb36126ed103602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e1090f5bd4ef6bb01c960b5b89226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:30:54.500553 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-e64234a9-575a-48da-aab3-085a73abbc78 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313" status: 200 len: 1314 microversion: 2.1 time: 1.304608 Oct 28 12:30:54.501449 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 17/47] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:30:53 2021] GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313 => generated 1314 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:30:54.527048 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-0f72c51e-d543-4545-909a-a43334ed8ddf tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Flavor limits 0:0:0 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:30:54.527771 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-0f72c51e-d543-4545-909a-a43334ed8ddf tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Image limits 0:0:0 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:30:54.528953 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-0f72c51e-d543-4545-909a-a43334ed8ddf tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Flavor pref 0:0:0 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:30:54.529739 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-0f72c51e-d543-4545-909a-a43334ed8ddf tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Image pref 0:0:0 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:30:54.530553 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-0f72c51e-d543-4545-909a-a43334ed8ddf tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:30:54.637781 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0f72c51e-d543-4545-909a-a43334ed8ddf tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:30:54.642610 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0f72c51e-d543-4545-909a-a43334ed8ddf tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:30:54.649142 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0f72c51e-d543-4545-909a-a43334ed8ddf tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:30:54.650692 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0f72c51e-d543-4545-909a-a43334ed8ddf tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:30:54.829627 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.quota [None req-0f72c51e-d543-4545-909a-a43334ed8ddf tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Getting quotas for project 89341f96003c41e9be94073b0ef97275. Resources: {'cores', 'instances', 'ram'} {{(pid=115877) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:30:54.849334 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.quota [None req-0f72c51e-d543-4545-909a-a43334ed8ddf tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Getting quotas for user 3ed2a525287d4d5cbde5977afba29c9d and project 89341f96003c41e9be94073b0ef97275. Resources: {'cores', 'instances', 'ram'} {{(pid=115877) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:30:54.903715 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-0f72c51e-d543-4545-909a-a43334ed8ddf tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Going to run 1 instances... {{(pid=115877) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:30:54.934316 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-0f72c51e-d543-4545-909a-a43334ed8ddf tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='575f28c8-0af2-4973-b3d9-a249e2400c6e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:30:55.308524 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-0f72c51e-d543-4545-909a-a43334ed8ddf tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.677575 Oct 28 12:30:55.321689 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 31/48] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Oct 28 12:30:50 2021] POST /compute/v2.1/servers => generated 383 bytes in 4685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 12:30:55.322469 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-22b3fac5-7af8-4f00-8277-f1f01d1a1163 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:55.323347 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-22b3fac5-7af8-4f00-8277-f1f01d1a1163 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:30:55.474006 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-22b3fac5-7af8-4f00-8277-f1f01d1a1163 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:30:55.483780 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-22b3fac5-7af8-4f00-8277-f1f01d1a1163 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1222 microversion: 2.1 time: 0.167255 Oct 28 12:30:55.490032 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 18/49] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:30:55 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1222 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:30:55.533433 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-03b9ea46-b827-42b1-843e-6dd856e297ac tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:55.534287 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-03b9ea46-b827-42b1-843e-6dd856e297ac tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] [instance: 3e3afd4f-1acd-48ae-af4c-1e8d190dd313] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:30:55.563257 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-03b9ea46-b827-42b1-843e-6dd856e297ac tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:30:55.585543 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-03b9ea46-b827-42b1-843e-6dd856e297ac tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:30:55.586394 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-03b9ea46-b827-42b1-843e-6dd856e297ac tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:30:55.594437 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-03b9ea46-b827-42b1-843e-6dd856e297ac tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:30:56.621159 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-b16ffb32-5f66-4309-aafe-adb0125df61b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'create', calling method: .version_select at 0x7f4a79f9b1f0>, body: {"keypair": {"name": "tempest-keypair-1051813444"}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:30:56.725069 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-b16ffb32-5f66-4309-aafe-adb0125df61b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Getting quotas for project 0ae5fd59e495402c829af6819f873149. Resources: {'key_pairs'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:30:56.740407 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-b16ffb32-5f66-4309-aafe-adb0125df61b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Getting quotas for user 4d38f499bdf74241a876e06ca3e05503 and project 0ae5fd59e495402c829af6819f873149. Resources: {'key_pairs'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:30:57.001467 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-03b9ea46-b827-42b1-843e-6dd856e297ac tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848238e66f2e42de8eb36126ed103602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e1090f5bd4ef6bb01c960b5b89226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:30:57.035826 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-03b9ea46-b827-42b1-843e-6dd856e297ac tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313" status: 200 len: 1314 microversion: 2.1 time: 1.509232 Oct 28 12:30:57.063896 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 32/50] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:30:55 2021] GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313 => generated 1314 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:30:57.082099 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-c94f6310-224a-4204-8b60-163b495b3403 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:57.089893 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-c94f6310-224a-4204-8b60-163b495b3403 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:30:57.104386 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c94f6310-224a-4204-8b60-163b495b3403 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:30:57.124262 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c94f6310-224a-4204-8b60-163b495b3403 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:30:57.127896 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c94f6310-224a-4204-8b60-163b495b3403 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:30:57.130611 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c94f6310-224a-4204-8b60-163b495b3403 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:30:57.283830 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-b16ffb32-5f66-4309-aafe-adb0125df61b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Getting quotas for project 0ae5fd59e495402c829af6819f873149. Resources: {'key_pairs'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:30:57.290481 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-b16ffb32-5f66-4309-aafe-adb0125df61b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Getting quotas for user 4d38f499bdf74241a876e06ca3e05503 and project 0ae5fd59e495402c829af6819f873149. Resources: {'key_pairs'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:30:57.335540 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-b16ffb32-5f66-4309-aafe-adb0125df61b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.784657 Oct 28 12:30:57.345312 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 19/51] 10.222.0.62 () {62 vars in 1198 bytes} [Thu Oct 28 12:30:55 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1796 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Oct 28 12:30:57.390580 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-c94f6310-224a-4204-8b60-163b495b3403 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:30:57.404073 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-c94f6310-224a-4204-8b60-163b495b3403 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1274 microversion: 2.1 time: 0.338884 Oct 28 12:30:57.410120 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 33/52] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:30:57 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1274 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:30:58.065238 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-05b21a12-8729-4ebc-9f46-8a6a6be94230 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:58.065934 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-05b21a12-8729-4ebc-9f46-8a6a6be94230 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] [instance: 3e3afd4f-1acd-48ae-af4c-1e8d190dd313] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:30:58.073659 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-05b21a12-8729-4ebc-9f46-8a6a6be94230 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:30:58.080788 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-05b21a12-8729-4ebc-9f46-8a6a6be94230 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:30:58.080937 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-85253b3c-64c8-4030-bf6d-e3d472bb06d2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'create', calling method: .version_select at 0x7f4a7a009670>, body: {"keypair": {"name": "tempest-keypair-207466005"}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:30:58.088112 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-05b21a12-8729-4ebc-9f46-8a6a6be94230 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:30:58.091087 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-05b21a12-8729-4ebc-9f46-8a6a6be94230 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:30:58.133122 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-85253b3c-64c8-4030-bf6d-e3d472bb06d2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Getting quotas for project c5337ec1ac12488aa4e8ecbab298da10. Resources: {'key_pairs'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:30:58.161821 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-85253b3c-64c8-4030-bf6d-e3d472bb06d2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Getting quotas for user 86f15cc4fe5a4148984af18a9a49fa31 and project c5337ec1ac12488aa4e8ecbab298da10. Resources: {'key_pairs'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:30:58.556926 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-05b21a12-8729-4ebc-9f46-8a6a6be94230 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848238e66f2e42de8eb36126ed103602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e1090f5bd4ef6bb01c960b5b89226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:30:58.577592 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-05b21a12-8729-4ebc-9f46-8a6a6be94230 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313" status: 200 len: 1314 microversion: 2.1 time: 0.509974 Oct 28 12:30:58.578956 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 34/53] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:30:58 2021] GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313 => generated 1314 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:30:58.584925 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-995072c8-2397-4778-bd8e-3f19d9f4857d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:58.585870 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-995072c8-2397-4778-bd8e-3f19d9f4857d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:30:58.602954 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-995072c8-2397-4778-bd8e-3f19d9f4857d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:30:58.605252 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-995072c8-2397-4778-bd8e-3f19d9f4857d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:30:58.615091 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-995072c8-2397-4778-bd8e-3f19d9f4857d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:30:58.615678 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-995072c8-2397-4778-bd8e-3f19d9f4857d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:30:59.425980 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-995072c8-2397-4778-bd8e-3f19d9f4857d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:30:59.438207 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-995072c8-2397-4778-bd8e-3f19d9f4857d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1280 microversion: 2.1 time: 0.857732 Oct 28 12:30:59.452944 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 35/54] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:30:58 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1280 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:30:59.597311 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-a2109e4b-e73f-4b82-a9b0-e5accc5ffdc9 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:30:59.597975 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-a2109e4b-e73f-4b82-a9b0-e5accc5ffdc9 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] [instance: 3e3afd4f-1acd-48ae-af4c-1e8d190dd313] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:30:59.611074 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a2109e4b-e73f-4b82-a9b0-e5accc5ffdc9 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:30:59.611527 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a2109e4b-e73f-4b82-a9b0-e5accc5ffdc9 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:30:59.612310 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a2109e4b-e73f-4b82-a9b0-e5accc5ffdc9 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:30:59.615157 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a2109e4b-e73f-4b82-a9b0-e5accc5ffdc9 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:30:59.912742 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-85253b3c-64c8-4030-bf6d-e3d472bb06d2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Getting quotas for project c5337ec1ac12488aa4e8ecbab298da10. Resources: {'key_pairs'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:30:59.919317 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-85253b3c-64c8-4030-bf6d-e3d472bb06d2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Getting quotas for user 86f15cc4fe5a4148984af18a9a49fa31 and project c5337ec1ac12488aa4e8ecbab298da10. Resources: {'key_pairs'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:30:59.939315 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-85253b3c-64c8-4030-bf6d-e3d472bb06d2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 2.591540 Oct 28 12:30:59.939569 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 20/55] 10.222.0.62 () {60 vars in 1157 bytes} [Thu Oct 28 12:30:57 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 2593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:00.471314 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-b7341bc9-05b5-466a-acac-ecc9ccae9844 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:00.473514 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-b7341bc9-05b5-466a-acac-ecc9ccae9844 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:00.517162 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b7341bc9-05b5-466a-acac-ecc9ccae9844 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:00.526657 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b7341bc9-05b5-466a-acac-ecc9ccae9844 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:00.537306 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b7341bc9-05b5-466a-acac-ecc9ccae9844 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:00.541454 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b7341bc9-05b5-466a-acac-ecc9ccae9844 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:00.581221 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-a2109e4b-e73f-4b82-a9b0-e5accc5ffdc9 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848238e66f2e42de8eb36126ed103602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e1090f5bd4ef6bb01c960b5b89226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:00.590767 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-a2109e4b-e73f-4b82-a9b0-e5accc5ffdc9 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313" status: 200 len: 1314 microversion: 2.1 time: 0.998262 Oct 28 12:31:00.593010 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 36/56] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:30:59 2021] GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313 => generated 1314 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:00.860992 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-16e59967-bc43-48a9-aeec-8a65d6880043 req-644ffa3d-609c-476d-8896-d7cfbe3ef22c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "358e5707-b5af-4ff5-9308-489054458c20", "tag": "c200af92-6387-4188-81f1-0baf6b616b1f"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:00.868260 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:31:00.868260 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:31:00.871205 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-b7341bc9-05b5-466a-acac-ecc9ccae9844 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:00.889680 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-b7341bc9-05b5-466a-acac-ecc9ccae9844 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1280 microversion: 2.1 time: 0.430098 Oct 28 12:31:00.893066 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 21/57] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:00 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1280 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:00.915346 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-16e59967-bc43-48a9-aeec-8a65d6880043 req-644ffa3d-609c-476d-8896-d7cfbe3ef22c service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:00.915802 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-16e59967-bc43-48a9-aeec-8a65d6880043 req-644ffa3d-609c-476d-8896-d7cfbe3ef22c service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:00.986691 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-16e59967-bc43-48a9-aeec-8a65d6880043 req-644ffa3d-609c-476d-8896-d7cfbe3ef22c service nova] Creating event network-changed:c200af92-6387-4188-81f1-0baf6b616b1f for instance 358e5707-b5af-4ff5-9308-489054458c20 on hv-cinder-81514 Oct 28 12:31:00.987997 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-16e59967-bc43-48a9-aeec-8a65d6880043 req-644ffa3d-609c-476d-8896-d7cfbe3ef22c service nova] Acquired lock "compute-rpcapi-router" {{(pid=115877) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Oct 28 12:31:00.992253 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-581325ff-ba6f-4c29-a323-89222455b33c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:00.993386 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-581325ff-ba6f-4c29-a323-89222455b33c None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:00.995310 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-581325ff-ba6f-4c29-a323-89222455b33c None None] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:00.999226 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-581325ff-ba6f-4c29-a323-89222455b33c None None] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:01.021502 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.compute.rpcapi [None req-581325ff-ba6f-4c29-a323-89222455b33c None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Oct 28 12:31:01.023173 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-581325ff-ba6f-4c29-a323-89222455b33c None None] Releasing lock "compute-rpcapi-router" {{(pid=115877) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Oct 28 12:31:01.098405 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-581325ff-ba6f-4c29-a323-89222455b33c None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.239115 Oct 28 12:31:01.099756 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 37/58] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:31:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:31:01.608503 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-87d29595-a8a9-451c-b056-413ae7d6949f tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:01.609945 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-87d29595-a8a9-451c-b056-413ae7d6949f tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] [instance: 3e3afd4f-1acd-48ae-af4c-1e8d190dd313] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:01.619157 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-87d29595-a8a9-451c-b056-413ae7d6949f tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:01.619999 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-87d29595-a8a9-451c-b056-413ae7d6949f tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:01.620978 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-87d29595-a8a9-451c-b056-413ae7d6949f tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:01.621557 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-87d29595-a8a9-451c-b056-413ae7d6949f tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:01.910929 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-6ca602f1-9696-4e0b-a630-ec9baca87822 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:01.913067 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-6ca602f1-9696-4e0b-a630-ec9baca87822 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:01.931034 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6ca602f1-9696-4e0b-a630-ec9baca87822 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:01.931561 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6ca602f1-9696-4e0b-a630-ec9baca87822 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:01.934794 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6ca602f1-9696-4e0b-a630-ec9baca87822 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:01.935614 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6ca602f1-9696-4e0b-a630-ec9baca87822 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:01.941162 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-87d29595-a8a9-451c-b056-413ae7d6949f tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848238e66f2e42de8eb36126ed103602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e1090f5bd4ef6bb01c960b5b89226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:01.978591 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-87d29595-a8a9-451c-b056-413ae7d6949f tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313" status: 200 len: 1314 microversion: 2.1 time: 0.373560 Oct 28 12:31:01.989157 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 22/59] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:01 2021] GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313 => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:03.007040 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-af1ceb1b-f979-4039-87a2-89dbe79b8937 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:03.009467 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-af1ceb1b-f979-4039-87a2-89dbe79b8937 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] [instance: 3e3afd4f-1acd-48ae-af4c-1e8d190dd313] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:03.026679 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-af1ceb1b-f979-4039-87a2-89dbe79b8937 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:03.027497 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-af1ceb1b-f979-4039-87a2-89dbe79b8937 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:03.028607 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-af1ceb1b-f979-4039-87a2-89dbe79b8937 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:03.029258 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-af1ceb1b-f979-4039-87a2-89dbe79b8937 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:03.251162 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-6ca602f1-9696-4e0b-a630-ec9baca87822 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:03.263681 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-6ca602f1-9696-4e0b-a630-ec9baca87822 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1322 microversion: 2.1 time: 1.358178 Oct 28 12:31:03.267662 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 38/60] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:01 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1322 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:04.287869 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-af1ceb1b-f979-4039-87a2-89dbe79b8937 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848238e66f2e42de8eb36126ed103602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e1090f5bd4ef6bb01c960b5b89226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:04.289588 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-29507f79-d3ab-4e51-946f-05cdcd901f36 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:04.292622 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-29507f79-d3ab-4e51-946f-05cdcd901f36 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:04.296675 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-af1ceb1b-f979-4039-87a2-89dbe79b8937 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313" status: 200 len: 1314 microversion: 2.1 time: 1.294803 Oct 28 12:31:04.311068 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-29507f79-d3ab-4e51-946f-05cdcd901f36 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:04.311876 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-29507f79-d3ab-4e51-946f-05cdcd901f36 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:04.315080 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-29507f79-d3ab-4e51-946f-05cdcd901f36 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:04.316313 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 23/61] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:03 2021] GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313 => generated 1314 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:04.318075 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-29507f79-d3ab-4e51-946f-05cdcd901f36 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:04.734453 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-29507f79-d3ab-4e51-946f-05cdcd901f36 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:04.750916 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-29507f79-d3ab-4e51-946f-05cdcd901f36 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1322 microversion: 2.1 time: 0.469562 Oct 28 12:31:04.754063 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 39/62] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:04 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1322 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:05.302991 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-b05c14c0-4641-475b-b25e-d7ba0cca47ee req-d0fdee56-d889-4461-9599-fa75e48acbba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9a11648-1512-4384-b703-4864b9027474", "tag": "4519c095-ffbc-4831-aac3-a12e3b01647c"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:05.304545 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:31:05.304545 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:31:05.324997 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-0334ee11-5224-4b27-acd0-44238e3a8573 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:05.325608 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-0334ee11-5224-4b27-acd0-44238e3a8573 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] [instance: 3e3afd4f-1acd-48ae-af4c-1e8d190dd313] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:05.339643 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0334ee11-5224-4b27-acd0-44238e3a8573 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:05.341566 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-b05c14c0-4641-475b-b25e-d7ba0cca47ee req-d0fdee56-d889-4461-9599-fa75e48acbba service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:05.343601 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-b05c14c0-4641-475b-b25e-d7ba0cca47ee req-d0fdee56-d889-4461-9599-fa75e48acbba service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:05.344442 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0334ee11-5224-4b27-acd0-44238e3a8573 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:05.348474 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0334ee11-5224-4b27-acd0-44238e3a8573 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:05.352538 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0334ee11-5224-4b27-acd0-44238e3a8573 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:05.386281 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-b05c14c0-4641-475b-b25e-d7ba0cca47ee req-d0fdee56-d889-4461-9599-fa75e48acbba service nova] Creating event network-changed:4519c095-ffbc-4831-aac3-a12e3b01647c for instance e9a11648-1512-4384-b703-4864b9027474 on hv-cinder-81514 Oct 28 12:31:05.400041 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-b05c14c0-4641-475b-b25e-d7ba0cca47ee req-d0fdee56-d889-4461-9599-fa75e48acbba service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202785 Oct 28 12:31:05.411364 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 24/63] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:31:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:31:05.777410 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-29dccac1-40a7-45b5-a740-60a42ed7a307 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:05.779058 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-29dccac1-40a7-45b5-a740-60a42ed7a307 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:05.802781 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-29dccac1-40a7-45b5-a740-60a42ed7a307 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:05.805117 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-29dccac1-40a7-45b5-a740-60a42ed7a307 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:05.807874 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-29dccac1-40a7-45b5-a740-60a42ed7a307 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:05.808684 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-29dccac1-40a7-45b5-a740-60a42ed7a307 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:06.090580 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-0334ee11-5224-4b27-acd0-44238e3a8573 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848238e66f2e42de8eb36126ed103602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e1090f5bd4ef6bb01c960b5b89226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:06.104466 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-0334ee11-5224-4b27-acd0-44238e3a8573 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313" status: 200 len: 1314 microversion: 2.1 time: 0.780501 Oct 28 12:31:06.107420 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 40/64] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:05 2021] GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313 => generated 1314 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:06.556459 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-29dccac1-40a7-45b5-a740-60a42ed7a307 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:06.578986 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-29dccac1-40a7-45b5-a740-60a42ed7a307 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1322 microversion: 2.1 time: 0.811094 Oct 28 12:31:06.582561 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 25/65] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:05 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1322 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:07.128272 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-04d77257-a76e-4487-a1db-c47f78ea6b0a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-876880509", "imageRef": "575f28c8-0af2-4973-b3d9-a249e2400c6e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "91b3814f-2032-4bff-af3a-f4aaffcf631a"}], "security_groups": [{"name": "tempest-securitygroup--1170004287"}], "key_name": "tempest-keypair-1051813444", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:07.128862 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-aa12772c-648c-4cf5-bff3-e58e6c64ae2e tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:07.130045 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-aa12772c-648c-4cf5-bff3-e58e6c64ae2e tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] [instance: 3e3afd4f-1acd-48ae-af4c-1e8d190dd313] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:07.158731 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-aa12772c-648c-4cf5-bff3-e58e6c64ae2e tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:07.162207 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-aa12772c-648c-4cf5-bff3-e58e6c64ae2e tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:07.166947 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-aa12772c-648c-4cf5-bff3-e58e6c64ae2e tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:07.175182 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-aa12772c-648c-4cf5-bff3-e58e6c64ae2e tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:07.830467 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.network.neutron [None req-04d77257-a76e-4487-a1db-c47f78ea6b0a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] validate_networks() for [('91b3814f-2032-4bff-af3a-f4aaffcf631a', None, None, None, None, None)] {{(pid=115876) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:31:07.978587 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-aa12772c-648c-4cf5-bff3-e58e6c64ae2e tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848238e66f2e42de8eb36126ed103602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e1090f5bd4ef6bb01c960b5b89226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:07.985965 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-aa12772c-648c-4cf5-bff3-e58e6c64ae2e tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313" status: 200 len: 1314 microversion: 2.1 time: 0.866242 Oct 28 12:31:07.986551 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 41/66] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:07 2021] GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313 => generated 1314 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:08.006175 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-e5481eaa-81f1-4be9-bcb2-3a96d9e7ab00 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:08.006790 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-e5481eaa-81f1-4be9-bcb2-3a96d9e7ab00 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:08.025497 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e5481eaa-81f1-4be9-bcb2-3a96d9e7ab00 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:08.026176 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e5481eaa-81f1-4be9-bcb2-3a96d9e7ab00 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:08.026860 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e5481eaa-81f1-4be9-bcb2-3a96d9e7ab00 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:08.027251 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e5481eaa-81f1-4be9-bcb2-3a96d9e7ab00 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:08.371827 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-e5481eaa-81f1-4be9-bcb2-3a96d9e7ab00 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:08.380770 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-e5481eaa-81f1-4be9-bcb2-3a96d9e7ab00 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1322 microversion: 2.1 time: 0.378217 Oct 28 12:31:08.383026 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 42/67] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:07 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1322 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:08.647352 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-609972c5-0ab8-42aa-bb11-8e494a13b001 req-3dc48c69-dcf5-43b6-93ec-dbdbf9ea24ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e3afd4f-1acd-48ae-af4c-1e8d190dd313", "name": "network-vif-plugged", "status": "completed", "tag": "6b8de827-c643-404c-86f6-5c0f33960730"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:08.651811 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:31:08.651811 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:31:08.667852 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-609972c5-0ab8-42aa-bb11-8e494a13b001 req-3dc48c69-dcf5-43b6-93ec-dbdbf9ea24ba service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:08.672223 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-04d77257-a76e-4487-a1db-c47f78ea6b0a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Flavor limits 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:31:08.673171 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-04d77257-a76e-4487-a1db-c47f78ea6b0a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Image limits 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:31:08.673882 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-04d77257-a76e-4487-a1db-c47f78ea6b0a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Flavor pref 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:31:08.674517 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-04d77257-a76e-4487-a1db-c47f78ea6b0a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Image pref 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:31:08.675151 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-04d77257-a76e-4487-a1db-c47f78ea6b0a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:31:08.678225 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-609972c5-0ab8-42aa-bb11-8e494a13b001 req-3dc48c69-dcf5-43b6-93ec-dbdbf9ea24ba service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:08.695518 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-04d77257-a76e-4487-a1db-c47f78ea6b0a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:08.696003 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-04d77257-a76e-4487-a1db-c47f78ea6b0a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:08.699679 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-04d77257-a76e-4487-a1db-c47f78ea6b0a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:08.700183 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-04d77257-a76e-4487-a1db-c47f78ea6b0a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:08.704758 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-609972c5-0ab8-42aa-bb11-8e494a13b001 req-3dc48c69-dcf5-43b6-93ec-dbdbf9ea24ba service nova] Creating event network-vif-plugged:6b8de827-c643-404c-86f6-5c0f33960730 for instance 3e3afd4f-1acd-48ae-af4c-1e8d190dd313 on hv-cinder-81514 Oct 28 12:31:08.712376 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-609972c5-0ab8-42aa-bb11-8e494a13b001 req-3dc48c69-dcf5-43b6-93ec-dbdbf9ea24ba service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.324209 Oct 28 12:31:08.714194 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 43/68] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:31:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:31:08.726783 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-e9f02b10-7750-4333-bcee-ce1e56dcb52c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-517795609", "imageRef": "575f28c8-0af2-4973-b3d9-a249e2400c6e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c977e2aa-b8cb-4592-9494-ce66891f1b69"}], "security_groups": [{"name": "tempest-securitygroup--261530278"}], "key_name": "tempest-keypair-207466005", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:08.747919 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-04d77257-a76e-4487-a1db-c47f78ea6b0a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Getting quotas for project 0ae5fd59e495402c829af6819f873149. Resources: {'cores', 'instances', 'ram'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:31:08.755914 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-04d77257-a76e-4487-a1db-c47f78ea6b0a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Getting quotas for user 4d38f499bdf74241a876e06ca3e05503 and project 0ae5fd59e495402c829af6819f873149. Resources: {'cores', 'instances', 'ram'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:31:08.788460 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-04d77257-a76e-4487-a1db-c47f78ea6b0a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Going to run 1 instances... {{(pid=115876) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:31:08.792154 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-04d77257-a76e-4487-a1db-c47f78ea6b0a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='575f28c8-0af2-4973-b3d9-a249e2400c6e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:31:08.903374 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-04d77257-a76e-4487-a1db-c47f78ea6b0a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.773583 Oct 28 12:31:08.909865 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 26/69] 10.222.0.62 () {62 vars in 1187 bytes} [Thu Oct 28 12:31:07 2021] POST /compute/v2.1/servers => generated 402 bytes in 1786 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 12:31:08.922378 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.network.neutron [None req-e9f02b10-7750-4333-bcee-ce1e56dcb52c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] validate_networks() for [('c977e2aa-b8cb-4592-9494-ce66891f1b69', None, None, None, None, None)] {{(pid=115877) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:31:08.963151 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-a1fa44e1-6311-4948-9b57-c58ddc751625 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:08.966921 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-a1fa44e1-6311-4948-9b57-c58ddc751625 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:09.255709 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-a1fa44e1-6311-4948-9b57-c58ddc751625 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:09.267990 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-a1fa44e1-6311-4948-9b57-c58ddc751625 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:09.288196 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-a1fa44e1-6311-4948-9b57-c58ddc751625 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:09.292048 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-a1fa44e1-6311-4948-9b57-c58ddc751625 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1281 microversion: 2.20 time: 0.380100 Oct 28 12:31:09.303179 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 27/70] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:31:08 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1281 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:31:09.323719 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-45314bdf-27a8-43ed-8745-8c5ee0dda0c2 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:09.330947 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-45314bdf-27a8-43ed-8745-8c5ee0dda0c2 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] [instance: 3e3afd4f-1acd-48ae-af4c-1e8d190dd313] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:09.350318 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-45314bdf-27a8-43ed-8745-8c5ee0dda0c2 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:09.350765 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-45314bdf-27a8-43ed-8745-8c5ee0dda0c2 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:09.361620 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-45314bdf-27a8-43ed-8745-8c5ee0dda0c2 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:09.362086 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-45314bdf-27a8-43ed-8745-8c5ee0dda0c2 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:09.837771 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-45314bdf-27a8-43ed-8745-8c5ee0dda0c2 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848238e66f2e42de8eb36126ed103602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e1090f5bd4ef6bb01c960b5b89226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:09.859199 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-45314bdf-27a8-43ed-8745-8c5ee0dda0c2 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313" status: 200 len: 1314 microversion: 2.1 time: 0.552838 Oct 28 12:31:09.859793 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 28/71] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:09 2021] GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313 => generated 1314 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:09.909560 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-289765bb-1d8d-4c96-83b9-30380d23fd53 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:09.913545 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-289765bb-1d8d-4c96-83b9-30380d23fd53 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:09.929051 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-289765bb-1d8d-4c96-83b9-30380d23fd53 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:09.929423 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-289765bb-1d8d-4c96-83b9-30380d23fd53 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:09.932459 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-289765bb-1d8d-4c96-83b9-30380d23fd53 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:09.933034 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-289765bb-1d8d-4c96-83b9-30380d23fd53 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:10.528364 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-289765bb-1d8d-4c96-83b9-30380d23fd53 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:10.541321 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-289765bb-1d8d-4c96-83b9-30380d23fd53 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1322 microversion: 2.1 time: 0.662658 Oct 28 12:31:10.552968 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 29/72] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:09 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1322 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:10.559864 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-60c0cb79-c740-40c8-a420-a2291f2e45c7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:10.561268 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-60c0cb79-c740-40c8-a420-a2291f2e45c7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:10.569991 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-60c0cb79-c740-40c8-a420-a2291f2e45c7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:10.570607 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-60c0cb79-c740-40c8-a420-a2291f2e45c7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:10.573576 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-e9f02b10-7750-4333-bcee-ce1e56dcb52c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Flavor limits 0:0:0 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:31:10.573576 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-e9f02b10-7750-4333-bcee-ce1e56dcb52c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Image limits 0:0:0 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:31:10.574842 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-e9f02b10-7750-4333-bcee-ce1e56dcb52c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Flavor pref 0:0:0 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:31:10.574842 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-e9f02b10-7750-4333-bcee-ce1e56dcb52c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Image pref 0:0:0 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:31:10.575770 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-e9f02b10-7750-4333-bcee-ce1e56dcb52c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:31:10.576950 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-60c0cb79-c740-40c8-a420-a2291f2e45c7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:10.577855 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-60c0cb79-c740-40c8-a420-a2291f2e45c7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:10.596239 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e9f02b10-7750-4333-bcee-ce1e56dcb52c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:10.597125 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e9f02b10-7750-4333-bcee-ce1e56dcb52c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:10.600140 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e9f02b10-7750-4333-bcee-ce1e56dcb52c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:10.602970 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e9f02b10-7750-4333-bcee-ce1e56dcb52c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:10.682944 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.quota [None req-e9f02b10-7750-4333-bcee-ce1e56dcb52c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Getting quotas for project c5337ec1ac12488aa4e8ecbab298da10. Resources: {'cores', 'instances', 'ram'} {{(pid=115877) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:31:10.705205 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.quota [None req-e9f02b10-7750-4333-bcee-ce1e56dcb52c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Getting quotas for user 86f15cc4fe5a4148984af18a9a49fa31 and project c5337ec1ac12488aa4e8ecbab298da10. Resources: {'cores', 'instances', 'ram'} {{(pid=115877) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:31:10.723912 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-e9f02b10-7750-4333-bcee-ce1e56dcb52c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Going to run 1 instances... {{(pid=115877) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:31:10.726589 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-60c0cb79-c740-40c8-a420-a2291f2e45c7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:10.728572 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-e9f02b10-7750-4333-bcee-ce1e56dcb52c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='575f28c8-0af2-4973-b3d9-a249e2400c6e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:31:10.739522 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-60c0cb79-c740-40c8-a420-a2291f2e45c7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:10.744567 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-60c0cb79-c740-40c8-a420-a2291f2e45c7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:10.747877 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-60c0cb79-c740-40c8-a420-a2291f2e45c7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1333 microversion: 2.20 time: 0.192472 Oct 28 12:31:10.750951 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 30/73] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:31:10 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1333 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:31:10.821878 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-e9f02b10-7750-4333-bcee-ce1e56dcb52c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.101178 Oct 28 12:31:10.829550 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 44/74] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Oct 28 12:31:08 2021] POST /compute/v2.1/servers => generated 401 bytes in 2114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 12:31:10.837058 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-4cd3ff55-0549-4303-b25c-d127472cff9a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:10.837058 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-4cd3ff55-0549-4303-b25c-d127472cff9a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:10.876756 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-63ee37ff-3790-41f4-ba87-007de139f1fa tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:10.877629 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-63ee37ff-3790-41f4-ba87-007de139f1fa tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] [instance: 3e3afd4f-1acd-48ae-af4c-1e8d190dd313] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:10.932108 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-63ee37ff-3790-41f4-ba87-007de139f1fa tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:10.933815 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-63ee37ff-3790-41f4-ba87-007de139f1fa tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:10.936145 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-63ee37ff-3790-41f4-ba87-007de139f1fa tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:10.952813 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-63ee37ff-3790-41f4-ba87-007de139f1fa tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:11.074818 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-4cd3ff55-0549-4303-b25c-d127472cff9a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:11.081814 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-4cd3ff55-0549-4303-b25c-d127472cff9a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1236 microversion: 2.1 time: 0.252397 Oct 28 12:31:11.082396 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 31/75] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:10 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1236 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:11.381758 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-63ee37ff-3790-41f4-ba87-007de139f1fa tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848238e66f2e42de8eb36126ed103602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e1090f5bd4ef6bb01c960b5b89226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:11.391273 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-63ee37ff-3790-41f4-ba87-007de139f1fa tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313" status: 200 len: 1314 microversion: 2.1 time: 0.518517 Oct 28 12:31:11.392118 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 45/76] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:10 2021] GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313 => generated 1314 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:11.497269 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-d7ec626b-f1af-4b20-ab23-3699360295b9 req-405cb476-6515-4adf-8788-c0ad5ad32495 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "358e5707-b5af-4ff5-9308-489054458c20", "name": "network-vif-plugged", "status": "completed", "tag": "c200af92-6387-4188-81f1-0baf6b616b1f"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:11.499192 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:31:11.499192 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:31:11.523827 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-d7ec626b-f1af-4b20-ab23-3699360295b9 req-405cb476-6515-4adf-8788-c0ad5ad32495 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:11.528160 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-d7ec626b-f1af-4b20-ab23-3699360295b9 req-405cb476-6515-4adf-8788-c0ad5ad32495 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:11.563799 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-5735030a-db75-4021-862a-b820a697b01c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:11.564467 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-5735030a-db75-4021-862a-b820a697b01c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:11.595669 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5735030a-db75-4021-862a-b820a697b01c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:11.596456 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5735030a-db75-4021-862a-b820a697b01c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:11.597117 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5735030a-db75-4021-862a-b820a697b01c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:11.609038 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5735030a-db75-4021-862a-b820a697b01c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:11.631822 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-d7ec626b-f1af-4b20-ab23-3699360295b9 req-405cb476-6515-4adf-8788-c0ad5ad32495 service nova] Creating event network-vif-plugged:c200af92-6387-4188-81f1-0baf6b616b1f for instance 358e5707-b5af-4ff5-9308-489054458c20 on hv-cinder-81514 Oct 28 12:31:11.646020 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-d7ec626b-f1af-4b20-ab23-3699360295b9 req-405cb476-6515-4adf-8788-c0ad5ad32495 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153904 Oct 28 12:31:11.664594 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 32/77] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:31:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:31:11.769814 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-345ccda2-14a2-4ed4-ab09-407d02243d67 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:11.770784 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-345ccda2-14a2-4ed4-ab09-407d02243d67 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:11.792869 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-345ccda2-14a2-4ed4-ab09-407d02243d67 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:11.799953 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-345ccda2-14a2-4ed4-ab09-407d02243d67 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:11.809322 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-345ccda2-14a2-4ed4-ab09-407d02243d67 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:11.813416 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-345ccda2-14a2-4ed4-ab09-407d02243d67 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:12.012025 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-5735030a-db75-4021-862a-b820a697b01c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:12.061874 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-5735030a-db75-4021-862a-b820a697b01c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1322 microversion: 2.1 time: 0.501261 Oct 28 12:31:12.068182 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 46/78] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:11 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1322 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:12.105811 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-fb5a2441-d6f1-4c39-b11b-56a86ea5af19 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:12.107574 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-fb5a2441-d6f1-4c39-b11b-56a86ea5af19 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:12.119940 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fb5a2441-d6f1-4c39-b11b-56a86ea5af19 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:12.121132 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fb5a2441-d6f1-4c39-b11b-56a86ea5af19 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:12.122139 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fb5a2441-d6f1-4c39-b11b-56a86ea5af19 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:12.122907 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fb5a2441-d6f1-4c39-b11b-56a86ea5af19 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:12.279810 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-345ccda2-14a2-4ed4-ab09-407d02243d67 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:12.293820 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-345ccda2-14a2-4ed4-ab09-407d02243d67 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:12.295431 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-345ccda2-14a2-4ed4-ab09-407d02243d67 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:12.297091 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-345ccda2-14a2-4ed4-ab09-407d02243d67 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1339 microversion: 2.20 time: 0.531914 Oct 28 12:31:12.302276 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 33/79] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:31:11 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1339 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:31:12.371822 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-fb5a2441-d6f1-4c39-b11b-56a86ea5af19 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:12.387887 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-fb5a2441-d6f1-4c39-b11b-56a86ea5af19 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1240 microversion: 2.1 time: 0.286980 Oct 28 12:31:12.389338 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 47/80] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:12 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1240 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:12.410532 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-38cb502a-5de7-4550-926f-ffaf554874ed tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:12.412128 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-38cb502a-5de7-4550-926f-ffaf554874ed tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] [instance: 3e3afd4f-1acd-48ae-af4c-1e8d190dd313] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:12.423979 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-38cb502a-5de7-4550-926f-ffaf554874ed tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:12.426262 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-38cb502a-5de7-4550-926f-ffaf554874ed tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:12.427332 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-38cb502a-5de7-4550-926f-ffaf554874ed tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:12.427953 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-38cb502a-5de7-4550-926f-ffaf554874ed tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:12.810340 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-38cb502a-5de7-4550-926f-ffaf554874ed tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848238e66f2e42de8eb36126ed103602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e1090f5bd4ef6bb01c960b5b89226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:12.822758 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-38cb502a-5de7-4550-926f-ffaf554874ed tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313" status: 200 len: 1501 microversion: 2.1 time: 0.417104 Oct 28 12:31:12.824038 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 34/81] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:12 2021] GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313 => generated 1501 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:13.092364 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-fefe4047-3d23-4f11-829b-f4908ecbe140 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:13.093095 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-fefe4047-3d23-4f11-829b-f4908ecbe140 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:13.115748 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fefe4047-3d23-4f11-829b-f4908ecbe140 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:13.116455 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fefe4047-3d23-4f11-829b-f4908ecbe140 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:13.120918 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fefe4047-3d23-4f11-829b-f4908ecbe140 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:13.124595 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fefe4047-3d23-4f11-829b-f4908ecbe140 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:13.317391 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-5d3bc53c-2c1b-4db4-95c1-576459c804de tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:13.318048 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-5d3bc53c-2c1b-4db4-95c1-576459c804de tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:13.328227 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5d3bc53c-2c1b-4db4-95c1-576459c804de tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:13.344203 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5d3bc53c-2c1b-4db4-95c1-576459c804de tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:13.347501 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5d3bc53c-2c1b-4db4-95c1-576459c804de tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:13.352993 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5d3bc53c-2c1b-4db4-95c1-576459c804de tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:14.368544 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-fefe4047-3d23-4f11-829b-f4908ecbe140 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:14.384050 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-fefe4047-3d23-4f11-829b-f4908ecbe140 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1322 microversion: 2.1 time: 1.298994 Oct 28 12:31:14.400743 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 48/82] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:13 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1322 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:14.410231 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-89fec802-26c0-4d1a-b8e9-c2ecd163fe62 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:14.420627 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-89fec802-26c0-4d1a-b8e9-c2ecd163fe62 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:14.445991 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-89fec802-26c0-4d1a-b8e9-c2ecd163fe62 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:14.450871 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-89fec802-26c0-4d1a-b8e9-c2ecd163fe62 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:14.451998 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-89fec802-26c0-4d1a-b8e9-c2ecd163fe62 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:14.455741 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-89fec802-26c0-4d1a-b8e9-c2ecd163fe62 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:14.612547 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-89fec802-26c0-4d1a-b8e9-c2ecd163fe62 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:14.626982 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-89fec802-26c0-4d1a-b8e9-c2ecd163fe62 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1294 microversion: 2.1 time: 0.222016 Oct 28 12:31:14.629622 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 49/83] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:14 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1294 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:14.715583 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-5d3bc53c-2c1b-4db4-95c1-576459c804de tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:14.723667 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-5d3bc53c-2c1b-4db4-95c1-576459c804de tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:14.729200 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-5d3bc53c-2c1b-4db4-95c1-576459c804de tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:14.732022 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-5d3bc53c-2c1b-4db4-95c1-576459c804de tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1407 microversion: 2.20 time: 1.420070 Oct 28 12:31:14.735402 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 35/84] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:31:13 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1407 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:31:14.883326 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-0702c6f3-0334-4720-a7be-4cd62f7f73d6 req-ea6578f8-8855-4d72-8579-59c5e226ecaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9a11648-1512-4384-b703-4864b9027474", "name": "network-vif-plugged", "status": "completed", "tag": "4519c095-ffbc-4831-aac3-a12e3b01647c"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:14.885610 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:31:14.885610 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:31:14.915128 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-0702c6f3-0334-4720-a7be-4cd62f7f73d6 req-ea6578f8-8855-4d72-8579-59c5e226ecaa service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:14.915565 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-0702c6f3-0334-4720-a7be-4cd62f7f73d6 req-ea6578f8-8855-4d72-8579-59c5e226ecaa service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:14.970882 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-0702c6f3-0334-4720-a7be-4cd62f7f73d6 req-ea6578f8-8855-4d72-8579-59c5e226ecaa service nova] Creating event network-vif-plugged:4519c095-ffbc-4831-aac3-a12e3b01647c for instance e9a11648-1512-4384-b703-4864b9027474 on hv-cinder-81514 Oct 28 12:31:15.011796 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-0702c6f3-0334-4720-a7be-4cd62f7f73d6 req-ea6578f8-8855-4d72-8579-59c5e226ecaa service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131869 Oct 28 12:31:15.014488 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 50/85] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:31:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:31:15.070964 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-acaf3030-d0db-4a09-94ce-030392351334 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e8170bc-2779-48fb-9e59-1aaad48d9b63"}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:15.072378 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-acaf3030-d0db-4a09-94ce-030392351334 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] [instance: 3e3afd4f-1acd-48ae-af4c-1e8d190dd313] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:15.101176 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-acaf3030-d0db-4a09-94ce-030392351334 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:15.105699 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-acaf3030-d0db-4a09-94ce-030392351334 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:15.106749 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-acaf3030-d0db-4a09-94ce-030392351334 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:15.107462 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-acaf3030-d0db-4a09-94ce-030392351334 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:15.419148 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-e10e8cd2-b07a-4736-b387-ef1d9ee81c40 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:15.420554 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-e10e8cd2-b07a-4736-b387-ef1d9ee81c40 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:15.442416 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e10e8cd2-b07a-4736-b387-ef1d9ee81c40 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:15.443167 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e10e8cd2-b07a-4736-b387-ef1d9ee81c40 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:15.444126 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e10e8cd2-b07a-4736-b387-ef1d9ee81c40 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:15.445286 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e10e8cd2-b07a-4736-b387-ef1d9ee81c40 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:16.123052 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-e10e8cd2-b07a-4736-b387-ef1d9ee81c40 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:16.134447 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-e10e8cd2-b07a-4736-b387-ef1d9ee81c40 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1322 microversion: 2.1 time: 0.719600 Oct 28 12:31:16.140225 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 51/86] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:15 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1322 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:16.163470 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-8037de15-fdd1-4f41-a0f1-78d9428c2631 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:16.167809 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-8037de15-fdd1-4f41-a0f1-78d9428c2631 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:16.182493 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8037de15-fdd1-4f41-a0f1-78d9428c2631 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:16.185872 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8037de15-fdd1-4f41-a0f1-78d9428c2631 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:16.191617 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8037de15-fdd1-4f41-a0f1-78d9428c2631 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:16.192300 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8037de15-fdd1-4f41-a0f1-78d9428c2631 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:16.269455 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-acaf3030-d0db-4a09-94ce-030392351334 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] 10.222.0.62 "POST /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.212842 Oct 28 12:31:16.271790 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 36/87] 10.222.0.62 () {60 vars in 1322 bytes} [Thu Oct 28 12:31:15 2021] POST /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313/os-volume_attachments => generated 194 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:31:16.298652 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-2573aaf9-e2d6-4230-9c5c-a0e263a1091d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:16.299845 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-2573aaf9-e2d6-4230-9c5c-a0e263a1091d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:16.315460 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2573aaf9-e2d6-4230-9c5c-a0e263a1091d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:16.316165 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2573aaf9-e2d6-4230-9c5c-a0e263a1091d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:16.317156 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2573aaf9-e2d6-4230-9c5c-a0e263a1091d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:16.317838 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2573aaf9-e2d6-4230-9c5c-a0e263a1091d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:16.321225 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-8037de15-fdd1-4f41-a0f1-78d9428c2631 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:16.335518 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-8037de15-fdd1-4f41-a0f1-78d9428c2631 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1294 microversion: 2.1 time: 0.193994 Oct 28 12:31:16.344749 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 52/88] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:16 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1294 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:16.344749 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-d7067f8b-c13f-4f95-ad65-4e194de55366 req-74f23ca5-5c98-4bf6-b075-37ad53548751 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6a3a830-8175-434e-8c23-336ccacf7ef8", "tag": "fd7216a9-4fe8-4770-a641-9f1115f86217"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:16.346360 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:31:16.346360 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:31:16.374718 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-d7067f8b-c13f-4f95-ad65-4e194de55366 req-74f23ca5-5c98-4bf6-b075-37ad53548751 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:16.377490 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-d7067f8b-c13f-4f95-ad65-4e194de55366 req-74f23ca5-5c98-4bf6-b075-37ad53548751 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:16.406042 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-d7067f8b-c13f-4f95-ad65-4e194de55366 req-74f23ca5-5c98-4bf6-b075-37ad53548751 service nova] Creating event network-changed:fd7216a9-4fe8-4770-a641-9f1115f86217 for instance f6a3a830-8175-434e-8c23-336ccacf7ef8 on hv-cinder-81514 Oct 28 12:31:16.423473 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-d7067f8b-c13f-4f95-ad65-4e194de55366 req-74f23ca5-5c98-4bf6-b075-37ad53548751 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085389 Oct 28 12:31:16.425484 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 53/89] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:31:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:31:16.813456 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-2573aaf9-e2d6-4230-9c5c-a0e263a1091d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:16.839303 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-2573aaf9-e2d6-4230-9c5c-a0e263a1091d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:16.849395 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-2573aaf9-e2d6-4230-9c5c-a0e263a1091d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:16.854700 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-2573aaf9-e2d6-4230-9c5c-a0e263a1091d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1407 microversion: 2.20 time: 0.581193 Oct 28 12:31:16.865727 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 37/90] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:31:16 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1407 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:31:17.155111 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-c10b6528-af80-4497-8d08-b0a4eacd9a1f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:17.155819 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-c10b6528-af80-4497-8d08-b0a4eacd9a1f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:17.177102 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c10b6528-af80-4497-8d08-b0a4eacd9a1f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:17.177767 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c10b6528-af80-4497-8d08-b0a4eacd9a1f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:17.180339 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c10b6528-af80-4497-8d08-b0a4eacd9a1f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:17.184247 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c10b6528-af80-4497-8d08-b0a4eacd9a1f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:17.354666 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-3e08abf1-b526-4f13-ab6d-67b9c446ac75 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:17.355286 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-3e08abf1-b526-4f13-ab6d-67b9c446ac75 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:17.363614 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3e08abf1-b526-4f13-ab6d-67b9c446ac75 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:17.364454 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3e08abf1-b526-4f13-ab6d-67b9c446ac75 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:17.367328 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3e08abf1-b526-4f13-ab6d-67b9c446ac75 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:17.367995 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3e08abf1-b526-4f13-ab6d-67b9c446ac75 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:17.811133 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-c10b6528-af80-4497-8d08-b0a4eacd9a1f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:17.822515 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-3e08abf1-b526-4f13-ab6d-67b9c446ac75 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:17.828391 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-c10b6528-af80-4497-8d08-b0a4eacd9a1f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1322 microversion: 2.1 time: 0.680368 Oct 28 12:31:17.831105 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-3e08abf1-b526-4f13-ab6d-67b9c446ac75 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1361 microversion: 2.1 time: 0.480058 Oct 28 12:31:17.844344 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 38/92] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:17 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1361 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:17.844569 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 54/92] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:17 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1322 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:17.897252 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-f64fb22d-01e6-4f93-9b99-4b62645c86a4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:17.898180 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-f64fb22d-01e6-4f93-9b99-4b62645c86a4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:17.906962 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f64fb22d-01e6-4f93-9b99-4b62645c86a4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:17.907640 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f64fb22d-01e6-4f93-9b99-4b62645c86a4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:17.908903 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f64fb22d-01e6-4f93-9b99-4b62645c86a4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:17.909556 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f64fb22d-01e6-4f93-9b99-4b62645c86a4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:18.260951 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-f64fb22d-01e6-4f93-9b99-4b62645c86a4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:18.277727 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-f64fb22d-01e6-4f93-9b99-4b62645c86a4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:18.279714 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-f64fb22d-01e6-4f93-9b99-4b62645c86a4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:18.292306 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-f64fb22d-01e6-4f93-9b99-4b62645c86a4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1407 microversion: 2.20 time: 0.391820 Oct 28 12:31:18.297091 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 55/93] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:31:17 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1407 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:31:18.594338 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-c2c7a239-8432-4102-9060-e2be92922f80 req-1d97ed2b-513f-4c77-aad4-f314da1a7655 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b133627-e4a2-43dc-9613-8ef3d028862b", "tag": "fe4d3fd7-9134-42f8-a93d-9cbe08ca530e"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:18.599758 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:31:18.599758 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:31:18.611160 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-c2c7a239-8432-4102-9060-e2be92922f80 req-1d97ed2b-513f-4c77-aad4-f314da1a7655 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:18.611967 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-c2c7a239-8432-4102-9060-e2be92922f80 req-1d97ed2b-513f-4c77-aad4-f314da1a7655 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:18.635407 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-c2c7a239-8432-4102-9060-e2be92922f80 req-1d97ed2b-513f-4c77-aad4-f314da1a7655 service nova] Creating event network-changed:fe4d3fd7-9134-42f8-a93d-9cbe08ca530e for instance 1b133627-e4a2-43dc-9613-8ef3d028862b on hv-cinder-81514 Oct 28 12:31:18.644677 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-c2c7a239-8432-4102-9060-e2be92922f80 req-1d97ed2b-513f-4c77-aad4-f314da1a7655 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053853 Oct 28 12:31:18.646830 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 39/94] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:31:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:31:18.852101 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-88fe7859-fda9-44e5-ba0e-6d005d6b8b72 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:18.854135 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-2c5cf16a-0103-421b-b872-3c54652b6898 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:18.855076 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-88fe7859-fda9-44e5-ba0e-6d005d6b8b72 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:18.856264 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-2c5cf16a-0103-421b-b872-3c54652b6898 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:18.865825 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-88fe7859-fda9-44e5-ba0e-6d005d6b8b72 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:18.872570 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-88fe7859-fda9-44e5-ba0e-6d005d6b8b72 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:18.877359 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2c5cf16a-0103-421b-b872-3c54652b6898 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:18.878913 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2c5cf16a-0103-421b-b872-3c54652b6898 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:18.879376 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-88fe7859-fda9-44e5-ba0e-6d005d6b8b72 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:18.880798 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-88fe7859-fda9-44e5-ba0e-6d005d6b8b72 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:18.884005 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2c5cf16a-0103-421b-b872-3c54652b6898 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:18.885333 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2c5cf16a-0103-421b-b872-3c54652b6898 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:19.207152 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-2c5cf16a-0103-421b-b872-3c54652b6898 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:19.215405 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-2c5cf16a-0103-421b-b872-3c54652b6898 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1361 microversion: 2.1 time: 0.367640 Oct 28 12:31:19.216021 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 40/95] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:18 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1361 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:31:19.235120 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-88fe7859-fda9-44e5-ba0e-6d005d6b8b72 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:19.245242 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-88fe7859-fda9-44e5-ba0e-6d005d6b8b72 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1516 microversion: 2.1 time: 0.401608 Oct 28 12:31:19.246273 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 56/96] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:18 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1516 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:19.262628 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-ab99c147-d99b-485c-a74c-3f8ef0cb96ed tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:19.263683 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-ab99c147-d99b-485c-a74c-3f8ef0cb96ed tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:19.274482 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ab99c147-d99b-485c-a74c-3f8ef0cb96ed tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:19.274605 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ab99c147-d99b-485c-a74c-3f8ef0cb96ed tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:19.275410 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ab99c147-d99b-485c-a74c-3f8ef0cb96ed tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:19.275842 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ab99c147-d99b-485c-a74c-3f8ef0cb96ed tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:19.314440 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-5a9dcf29-a0c3-4aac-ab20-221489121518 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:19.315311 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-5a9dcf29-a0c3-4aac-ab20-221489121518 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:19.322922 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.objects.instance [None req-ab99c147-d99b-485c-a74c-3f8ef0cb96ed tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lazy-loading 'flavor' on Instance uuid e9a11648-1512-4384-b703-4864b9027474 {{(pid=115876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:31:19.328135 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5a9dcf29-a0c3-4aac-ab20-221489121518 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:19.328769 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5a9dcf29-a0c3-4aac-ab20-221489121518 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:19.331169 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5a9dcf29-a0c3-4aac-ab20-221489121518 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:19.331598 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5a9dcf29-a0c3-4aac-ab20-221489121518 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:19.533212 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-5a9dcf29-a0c3-4aac-ab20-221489121518 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:19.547577 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-5a9dcf29-a0c3-4aac-ab20-221489121518 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:19.552600 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-5a9dcf29-a0c3-4aac-ab20-221489121518 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:19.558233 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-5a9dcf29-a0c3-4aac-ab20-221489121518 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1407 microversion: 2.20 time: 0.246977 Oct 28 12:31:19.571829 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 57/97] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:31:19 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:31:19.613080 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-ab99c147-d99b-485c-a74c-3f8ef0cb96ed tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "POST /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474/action" status: 200 len: 32 microversion: 2.1 time: 0.353997 Oct 28 12:31:19.619025 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 41/98] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:31:19 2021] POST /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474/action => generated 32 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:31:19.639066 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-54639c5a-35a9-4ae6-8e5c-01e7df895619 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:19.641755 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-54639c5a-35a9-4ae6-8e5c-01e7df895619 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:19.666352 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-54639c5a-35a9-4ae6-8e5c-01e7df895619 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:19.668651 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-54639c5a-35a9-4ae6-8e5c-01e7df895619 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:19.669693 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-54639c5a-35a9-4ae6-8e5c-01e7df895619 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:19.671389 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-54639c5a-35a9-4ae6-8e5c-01e7df895619 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:20.234789 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-5e0b519f-e931-47ab-8b92-c02d8f4dd50d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:20.235638 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-5e0b519f-e931-47ab-8b92-c02d8f4dd50d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:20.250786 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5e0b519f-e931-47ab-8b92-c02d8f4dd50d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:20.251230 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5e0b519f-e931-47ab-8b92-c02d8f4dd50d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:20.252051 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5e0b519f-e931-47ab-8b92-c02d8f4dd50d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:20.252479 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5e0b519f-e931-47ab-8b92-c02d8f4dd50d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:20.306161 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-54639c5a-35a9-4ae6-8e5c-01e7df895619 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:20.314608 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-54639c5a-35a9-4ae6-8e5c-01e7df895619 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1522 microversion: 2.1 time: 0.693199 Oct 28 12:31:20.318892 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 58/99] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:19 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1522 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:20.564023 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-5e0b519f-e931-47ab-8b92-c02d8f4dd50d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:20.571672 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-5e0b519f-e931-47ab-8b92-c02d8f4dd50d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1361 microversion: 2.1 time: 0.341770 Oct 28 12:31:20.579787 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-fa6bb822-afa3-4241-b38e-2c157fd19d55 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:20.580478 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-fa6bb822-afa3-4241-b38e-2c157fd19d55 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:20.581757 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 42/100] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:20 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1361 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:31:20.588052 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fa6bb822-afa3-4241-b38e-2c157fd19d55 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:20.588860 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fa6bb822-afa3-4241-b38e-2c157fd19d55 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:20.589746 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fa6bb822-afa3-4241-b38e-2c157fd19d55 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:20.590355 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fa6bb822-afa3-4241-b38e-2c157fd19d55 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:20.863606 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-fa6bb822-afa3-4241-b38e-2c157fd19d55 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:20.877303 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-fa6bb822-afa3-4241-b38e-2c157fd19d55 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:20.879028 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-fa6bb822-afa3-4241-b38e-2c157fd19d55 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:20.884065 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-fa6bb822-afa3-4241-b38e-2c157fd19d55 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1407 microversion: 2.20 time: 0.307218 Oct 28 12:31:20.885778 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 59/101] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:31:20 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1407 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:31:21.337556 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-c9a9379e-b651-4d58-b3df-edec6b19e002 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:21.338793 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-c9a9379e-b651-4d58-b3df-edec6b19e002 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:21.349263 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c9a9379e-b651-4d58-b3df-edec6b19e002 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:21.350701 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c9a9379e-b651-4d58-b3df-edec6b19e002 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:21.351469 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c9a9379e-b651-4d58-b3df-edec6b19e002 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:21.353108 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c9a9379e-b651-4d58-b3df-edec6b19e002 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:21.527283 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-c9a9379e-b651-4d58-b3df-edec6b19e002 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:21.535137 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-c9a9379e-b651-4d58-b3df-edec6b19e002 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1522 microversion: 2.1 time: 0.203497 Oct 28 12:31:21.535903 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 43/102] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:21 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:21.588282 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-9a294668-579a-4592-807a-64c82b8f83eb tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:21.589740 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-9a294668-579a-4592-807a-64c82b8f83eb tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:21.596028 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9a294668-579a-4592-807a-64c82b8f83eb tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:21.596669 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9a294668-579a-4592-807a-64c82b8f83eb tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:21.597456 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9a294668-579a-4592-807a-64c82b8f83eb tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:21.597904 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9a294668-579a-4592-807a-64c82b8f83eb tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:21.728994 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-9a294668-579a-4592-807a-64c82b8f83eb tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:21.737550 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-9a294668-579a-4592-807a-64c82b8f83eb tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1361 microversion: 2.1 time: 0.153116 Oct 28 12:31:21.747721 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 60/103] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:21 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:21.902390 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-c8301053-85bb-4eb6-ba88-ca85d6ae03c3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:21.902990 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-c8301053-85bb-4eb6-ba88-ca85d6ae03c3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:21.910968 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c8301053-85bb-4eb6-ba88-ca85d6ae03c3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:21.911891 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c8301053-85bb-4eb6-ba88-ca85d6ae03c3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:21.912846 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c8301053-85bb-4eb6-ba88-ca85d6ae03c3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:21.913434 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c8301053-85bb-4eb6-ba88-ca85d6ae03c3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:22.189910 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-c8301053-85bb-4eb6-ba88-ca85d6ae03c3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:22.199923 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-c8301053-85bb-4eb6-ba88-ca85d6ae03c3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:22.201506 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-c8301053-85bb-4eb6-ba88-ca85d6ae03c3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:22.203205 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-c8301053-85bb-4eb6-ba88-ca85d6ae03c3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1407 microversion: 2.20 time: 0.305030 Oct 28 12:31:22.216390 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 44/104] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:31:21 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1407 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:31:22.551526 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-b645363b-25bd-42e3-9206-25b9abec9df4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:22.552758 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-b645363b-25bd-42e3-9206-25b9abec9df4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:22.559685 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b645363b-25bd-42e3-9206-25b9abec9df4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:22.560705 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b645363b-25bd-42e3-9206-25b9abec9df4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:22.561735 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b645363b-25bd-42e3-9206-25b9abec9df4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:22.562550 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b645363b-25bd-42e3-9206-25b9abec9df4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:22.649030 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-a96b0e1e-b8a8-4bba-80ad-65bb0b338a5a req-f441a92d-be98-4f54-9b98-91e4590e08c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6a3a830-8175-434e-8c23-336ccacf7ef8", "name": "network-vif-plugged", "status": "completed", "tag": "fd7216a9-4fe8-4770-a641-9f1115f86217"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:22.651512 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:31:22.651512 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:31:22.661016 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-a96b0e1e-b8a8-4bba-80ad-65bb0b338a5a req-f441a92d-be98-4f54-9b98-91e4590e08c5 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:22.661801 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-a96b0e1e-b8a8-4bba-80ad-65bb0b338a5a req-f441a92d-be98-4f54-9b98-91e4590e08c5 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:22.676592 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-a96b0e1e-b8a8-4bba-80ad-65bb0b338a5a req-f441a92d-be98-4f54-9b98-91e4590e08c5 service nova] Creating event network-vif-plugged:fd7216a9-4fe8-4770-a641-9f1115f86217 for instance f6a3a830-8175-434e-8c23-336ccacf7ef8 on hv-cinder-81514 Oct 28 12:31:22.682533 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-a96b0e1e-b8a8-4bba-80ad-65bb0b338a5a req-f441a92d-be98-4f54-9b98-91e4590e08c5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037647 Oct 28 12:31:22.683918 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 45/105] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:31:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:31:22.755728 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-72af6b77-af56-4f74-b7b9-3d8d116599cc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:22.756426 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-72af6b77-af56-4f74-b7b9-3d8d116599cc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:22.764215 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-b645363b-25bd-42e3-9206-25b9abec9df4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:22.772000 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-b645363b-25bd-42e3-9206-25b9abec9df4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1522 microversion: 2.1 time: 0.224067 Oct 28 12:31:22.775733 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 61/106] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:22 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:22.777537 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-72af6b77-af56-4f74-b7b9-3d8d116599cc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:22.781330 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-72af6b77-af56-4f74-b7b9-3d8d116599cc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:22.782160 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-72af6b77-af56-4f74-b7b9-3d8d116599cc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:22.782791 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-72af6b77-af56-4f74-b7b9-3d8d116599cc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:22.987133 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-72af6b77-af56-4f74-b7b9-3d8d116599cc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:22.995160 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-72af6b77-af56-4f74-b7b9-3d8d116599cc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1361 microversion: 2.1 time: 0.243419 Oct 28 12:31:22.995744 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 46/107] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:22 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1361 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:31:23.221954 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-94af65d9-f306-4ea9-ab78-7762b6c872ba tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:23.222556 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-94af65d9-f306-4ea9-ab78-7762b6c872ba tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:23.228695 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-94af65d9-f306-4ea9-ab78-7762b6c872ba tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:23.229434 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-94af65d9-f306-4ea9-ab78-7762b6c872ba tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:23.230395 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-94af65d9-f306-4ea9-ab78-7762b6c872ba tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:23.231228 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-94af65d9-f306-4ea9-ab78-7762b6c872ba tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:23.402889 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-94af65d9-f306-4ea9-ab78-7762b6c872ba tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:23.414584 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-94af65d9-f306-4ea9-ab78-7762b6c872ba tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:23.416491 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-94af65d9-f306-4ea9-ab78-7762b6c872ba tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:23.418279 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-94af65d9-f306-4ea9-ab78-7762b6c872ba tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1407 microversion: 2.20 time: 0.199724 Oct 28 12:31:23.419174 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 62/108] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:31:23 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:31:23.792375 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-5d0c72db-5207-497d-916b-3a1ec99d80d2 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:23.793084 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-5d0c72db-5207-497d-916b-3a1ec99d80d2 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:23.800007 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5d0c72db-5207-497d-916b-3a1ec99d80d2 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:23.800505 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5d0c72db-5207-497d-916b-3a1ec99d80d2 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:23.801685 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5d0c72db-5207-497d-916b-3a1ec99d80d2 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:23.802945 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5d0c72db-5207-497d-916b-3a1ec99d80d2 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:23.951631 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-5d0c72db-5207-497d-916b-3a1ec99d80d2 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:23.959412 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-5d0c72db-5207-497d-916b-3a1ec99d80d2 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1522 microversion: 2.1 time: 0.170962 Oct 28 12:31:23.968840 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 47/109] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:23 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:31:24.011752 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-be10ff58-5595-4149-ac08-b2da6f49bf66 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:24.012356 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-be10ff58-5595-4149-ac08-b2da6f49bf66 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:24.025988 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-be10ff58-5595-4149-ac08-b2da6f49bf66 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:24.026945 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-be10ff58-5595-4149-ac08-b2da6f49bf66 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:24.027992 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-be10ff58-5595-4149-ac08-b2da6f49bf66 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:24.029002 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-be10ff58-5595-4149-ac08-b2da6f49bf66 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:24.180232 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-be10ff58-5595-4149-ac08-b2da6f49bf66 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:24.188469 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-be10ff58-5595-4149-ac08-b2da6f49bf66 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1361 microversion: 2.1 time: 0.180765 Oct 28 12:31:24.189082 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 63/110] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:24 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:31:24.438034 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-f80f913b-db81-49a7-ad58-e3706084aaf2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:24.438626 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-f80f913b-db81-49a7-ad58-e3706084aaf2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:24.445146 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f80f913b-db81-49a7-ad58-e3706084aaf2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:24.445665 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f80f913b-db81-49a7-ad58-e3706084aaf2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:24.446433 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f80f913b-db81-49a7-ad58-e3706084aaf2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:24.446855 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f80f913b-db81-49a7-ad58-e3706084aaf2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:24.588690 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f80f913b-db81-49a7-ad58-e3706084aaf2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:24.597485 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f80f913b-db81-49a7-ad58-e3706084aaf2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:24.598944 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f80f913b-db81-49a7-ad58-e3706084aaf2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:24.600092 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-f80f913b-db81-49a7-ad58-e3706084aaf2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1407 microversion: 2.20 time: 0.166683 Oct 28 12:31:24.600645 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 48/111] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:31:24 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:31:24.982654 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-8ddda52c-0c5c-4db6-b91a-23ac10cd9620 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:24.983468 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-8ddda52c-0c5c-4db6-b91a-23ac10cd9620 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:24.990486 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8ddda52c-0c5c-4db6-b91a-23ac10cd9620 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:24.991085 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8ddda52c-0c5c-4db6-b91a-23ac10cd9620 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:24.991977 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8ddda52c-0c5c-4db6-b91a-23ac10cd9620 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:24.992443 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8ddda52c-0c5c-4db6-b91a-23ac10cd9620 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:25.120782 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-8ddda52c-0c5c-4db6-b91a-23ac10cd9620 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:25.128374 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-8ddda52c-0c5c-4db6-b91a-23ac10cd9620 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1522 microversion: 2.1 time: 0.150534 Oct 28 12:31:25.128976 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 64/112] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:24 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:25.216620 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-3e68d26a-e321-4628-9159-9dd778ad34ab tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:25.217387 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-3e68d26a-e321-4628-9159-9dd778ad34ab tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:25.225672 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3e68d26a-e321-4628-9159-9dd778ad34ab tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:25.226212 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3e68d26a-e321-4628-9159-9dd778ad34ab tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:25.227216 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3e68d26a-e321-4628-9159-9dd778ad34ab tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:25.227639 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3e68d26a-e321-4628-9159-9dd778ad34ab tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:25.382436 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-3e68d26a-e321-4628-9159-9dd778ad34ab tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:25.390258 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-3e68d26a-e321-4628-9159-9dd778ad34ab tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1361 microversion: 2.1 time: 0.179229 Oct 28 12:31:25.390845 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 49/113] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:25 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:25.619637 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-6ba2d8e4-c123-4965-9d1d-60515063c5c2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:25.620266 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-6ba2d8e4-c123-4965-9d1d-60515063c5c2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:25.627041 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6ba2d8e4-c123-4965-9d1d-60515063c5c2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:25.627559 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6ba2d8e4-c123-4965-9d1d-60515063c5c2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:25.628312 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6ba2d8e4-c123-4965-9d1d-60515063c5c2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:25.628755 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6ba2d8e4-c123-4965-9d1d-60515063c5c2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:25.761181 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-6ba2d8e4-c123-4965-9d1d-60515063c5c2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:25.771350 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-6ba2d8e4-c123-4965-9d1d-60515063c5c2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:25.773346 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-6ba2d8e4-c123-4965-9d1d-60515063c5c2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:25.774575 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-6ba2d8e4-c123-4965-9d1d-60515063c5c2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1407 microversion: 2.20 time: 0.159039 Oct 28 12:31:25.775206 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 65/114] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:31:25 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:31:26.145783 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-1c714a61-85f0-4ad6-b487-e86198de5157 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:26.146634 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-1c714a61-85f0-4ad6-b487-e86198de5157 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:26.162356 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1c714a61-85f0-4ad6-b487-e86198de5157 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:26.163946 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1c714a61-85f0-4ad6-b487-e86198de5157 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:26.164796 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1c714a61-85f0-4ad6-b487-e86198de5157 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:26.165451 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1c714a61-85f0-4ad6-b487-e86198de5157 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:26.302676 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-1c714a61-85f0-4ad6-b487-e86198de5157 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:26.310616 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-1c714a61-85f0-4ad6-b487-e86198de5157 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1522 microversion: 2.1 time: 0.168707 Oct 28 12:31:26.311255 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 50/115] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:26 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:26.408299 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-c814e227-4b74-4570-b32e-22058e352160 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:26.408926 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-c814e227-4b74-4570-b32e-22058e352160 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:26.416434 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c814e227-4b74-4570-b32e-22058e352160 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:26.417101 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c814e227-4b74-4570-b32e-22058e352160 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:26.417864 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c814e227-4b74-4570-b32e-22058e352160 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:26.418593 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c814e227-4b74-4570-b32e-22058e352160 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:26.562014 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-c814e227-4b74-4570-b32e-22058e352160 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:26.572091 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-c814e227-4b74-4570-b32e-22058e352160 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1361 microversion: 2.1 time: 0.168382 Oct 28 12:31:26.572932 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 66/116] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:26 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:26.801703 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-6e078f3f-9064-4060-8d98-76da5a99b991 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:26.802720 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-6e078f3f-9064-4060-8d98-76da5a99b991 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:26.809439 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6e078f3f-9064-4060-8d98-76da5a99b991 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:26.810488 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6e078f3f-9064-4060-8d98-76da5a99b991 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:26.811502 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6e078f3f-9064-4060-8d98-76da5a99b991 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:26.812042 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6e078f3f-9064-4060-8d98-76da5a99b991 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:26.986314 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-6e078f3f-9064-4060-8d98-76da5a99b991 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:26.996024 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-6e078f3f-9064-4060-8d98-76da5a99b991 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:27.003740 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-6e078f3f-9064-4060-8d98-76da5a99b991 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:27.005804 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-6e078f3f-9064-4060-8d98-76da5a99b991 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1407 microversion: 2.20 time: 0.211788 Oct 28 12:31:27.006580 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 51/117] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:31:26 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:31:27.330114 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-9a63c1c1-0c49-4c53-a423-25e210a819b8 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:27.330786 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-9a63c1c1-0c49-4c53-a423-25e210a819b8 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:27.338609 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9a63c1c1-0c49-4c53-a423-25e210a819b8 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:27.338853 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9a63c1c1-0c49-4c53-a423-25e210a819b8 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:27.339945 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9a63c1c1-0c49-4c53-a423-25e210a819b8 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:27.340874 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9a63c1c1-0c49-4c53-a423-25e210a819b8 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:27.505431 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-9a63c1c1-0c49-4c53-a423-25e210a819b8 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:27.515332 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-9a63c1c1-0c49-4c53-a423-25e210a819b8 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1522 microversion: 2.1 time: 0.188673 Oct 28 12:31:27.516264 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 67/118] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:27 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:27.594935 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-aee949dc-e547-4168-8316-1afa4ee8999e tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:27.595919 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-aee949dc-e547-4168-8316-1afa4ee8999e tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:27.606684 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-aee949dc-e547-4168-8316-1afa4ee8999e tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:27.607409 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-aee949dc-e547-4168-8316-1afa4ee8999e tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:27.608762 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-aee949dc-e547-4168-8316-1afa4ee8999e tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:27.609398 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-aee949dc-e547-4168-8316-1afa4ee8999e tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:27.751686 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-aee949dc-e547-4168-8316-1afa4ee8999e tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:27.759632 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-aee949dc-e547-4168-8316-1afa4ee8999e tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1361 microversion: 2.1 time: 0.172841 Oct 28 12:31:27.760220 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 52/119] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:27 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:28.023301 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-d18587de-e895-45f9-b46e-46fa51c97671 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:28.023915 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-d18587de-e895-45f9-b46e-46fa51c97671 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:28.035775 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d18587de-e895-45f9-b46e-46fa51c97671 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:28.036793 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d18587de-e895-45f9-b46e-46fa51c97671 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:28.038297 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d18587de-e895-45f9-b46e-46fa51c97671 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:28.039163 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d18587de-e895-45f9-b46e-46fa51c97671 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:28.208359 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-d18587de-e895-45f9-b46e-46fa51c97671 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:28.217296 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-d18587de-e895-45f9-b46e-46fa51c97671 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:28.219287 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-d18587de-e895-45f9-b46e-46fa51c97671 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:28.221254 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-d18587de-e895-45f9-b46e-46fa51c97671 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1599 microversion: 2.20 time: 0.201312 Oct 28 12:31:28.222167 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 68/120] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:31:28 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1599 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:31:28.240954 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-b7a444fb-e4e0-4517-b5c0-410ab0b19826 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:28.241439 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-b7a444fb-e4e0-4517-b5c0-410ab0b19826 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:28.247907 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b7a444fb-e4e0-4517-b5c0-410ab0b19826 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:28.248346 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b7a444fb-e4e0-4517-b5c0-410ab0b19826 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:28.249139 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b7a444fb-e4e0-4517-b5c0-410ab0b19826 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:28.249557 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b7a444fb-e4e0-4517-b5c0-410ab0b19826 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:28.297533 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-b39d3aa9-5c11-46ab-8c77-2e5a6c7ff6c6 req-9f5596d2-5555-4c5f-9347-e662454a256c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b133627-e4a2-43dc-9613-8ef3d028862b", "name": "network-vif-plugged", "status": "completed", "tag": "fe4d3fd7-9134-42f8-a93d-9cbe08ca530e"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:28.300202 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:31:28.300202 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:31:28.308970 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-b39d3aa9-5c11-46ab-8c77-2e5a6c7ff6c6 req-9f5596d2-5555-4c5f-9347-e662454a256c service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:28.309601 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-b39d3aa9-5c11-46ab-8c77-2e5a6c7ff6c6 req-9f5596d2-5555-4c5f-9347-e662454a256c service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:28.323450 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-b39d3aa9-5c11-46ab-8c77-2e5a6c7ff6c6 req-9f5596d2-5555-4c5f-9347-e662454a256c service nova] Creating event network-vif-plugged:fe4d3fd7-9134-42f8-a93d-9cbe08ca530e for instance 1b133627-e4a2-43dc-9613-8ef3d028862b on hv-cinder-81514 Oct 28 12:31:28.331350 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-b39d3aa9-5c11-46ab-8c77-2e5a6c7ff6c6 req-9f5596d2-5555-4c5f-9347-e662454a256c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039168 Oct 28 12:31:28.332929 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 69/121] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:31:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:31:28.375254 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-b7a444fb-e4e0-4517-b5c0-410ab0b19826 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.138316 Oct 28 12:31:28.382392 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 53/122] 10.222.0.62 () {60 vars in 1315 bytes} [Thu Oct 28 12:31:28 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/os-interface => generated 285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:31:28.411977 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-ac712486-df01-487c-ab71-ea4c903199da tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:28.414583 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-ac712486-df01-487c-ab71-ea4c903199da tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] [instance: 3e3afd4f-1acd-48ae-af4c-1e8d190dd313] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:28.428053 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ac712486-df01-487c-ab71-ea4c903199da tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:28.430702 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ac712486-df01-487c-ab71-ea4c903199da tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:28.436510 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ac712486-df01-487c-ab71-ea4c903199da tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:28.437402 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ac712486-df01-487c-ab71-ea4c903199da tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:28.472989 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-ac712486-df01-487c-ab71-ea4c903199da tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] [instance: 3e3afd4f-1acd-48ae-af4c-1e8d190dd313] Going to try to terminate instance {{(pid=115877) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:31:28.533497 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-badec16c-1fa4-4a4e-b832-910b6c0ede7f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:28.534191 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-badec16c-1fa4-4a4e-b832-910b6c0ede7f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:28.547110 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-badec16c-1fa4-4a4e-b832-910b6c0ede7f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:28.547901 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-badec16c-1fa4-4a4e-b832-910b6c0ede7f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:28.551412 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-badec16c-1fa4-4a4e-b832-910b6c0ede7f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:28.554357 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-badec16c-1fa4-4a4e-b832-910b6c0ede7f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:28.750432 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-ac712486-df01-487c-ab71-ea4c903199da tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] 10.222.0.62 "DELETE /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313" status: 204 len: 0 microversion: 2.1 time: 0.347582 Oct 28 12:31:28.752040 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 70/123] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Oct 28 12:31:28 2021] DELETE /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:31:28.770991 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-46581407-93c2-41ce-8982-cbfefb313e46 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:28.772065 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-46581407-93c2-41ce-8982-cbfefb313e46 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] [instance: 3e3afd4f-1acd-48ae-af4c-1e8d190dd313] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:28.785174 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-46581407-93c2-41ce-8982-cbfefb313e46 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:28.785615 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-46581407-93c2-41ce-8982-cbfefb313e46 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:28.786507 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-46581407-93c2-41ce-8982-cbfefb313e46 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:28.786937 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-46581407-93c2-41ce-8982-cbfefb313e46 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:29.083730 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-46581407-93c2-41ce-8982-cbfefb313e46 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848238e66f2e42de8eb36126ed103602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e1090f5bd4ef6bb01c960b5b89226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:29.094592 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-46581407-93c2-41ce-8982-cbfefb313e46 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313" status: 200 len: 1553 microversion: 2.1 time: 0.326145 Oct 28 12:31:29.095210 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 71/124] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:28 2021] GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313 => generated 1553 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:29.100697 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-acaf6f22-5f93-455b-aad8-b292aac8857c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:29.107430 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-acaf6f22-5f93-455b-aad8-b292aac8857c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:29.109458 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-badec16c-1fa4-4a4e-b832-910b6c0ede7f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:29.113510 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-acaf6f22-5f93-455b-aad8-b292aac8857c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:29.114056 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-acaf6f22-5f93-455b-aad8-b292aac8857c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:29.114939 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-acaf6f22-5f93-455b-aad8-b292aac8857c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:29.115429 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-acaf6f22-5f93-455b-aad8-b292aac8857c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:29.121710 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-badec16c-1fa4-4a4e-b832-910b6c0ede7f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1522 microversion: 2.1 time: 0.592671 Oct 28 12:31:29.122529 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 54/125] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:28 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1522 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:29.319353 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-acaf6f22-5f93-455b-aad8-b292aac8857c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:29.329207 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-acaf6f22-5f93-455b-aad8-b292aac8857c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1361 microversion: 2.1 time: 0.232907 Oct 28 12:31:29.331865 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 72/126] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:29 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1361 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:30.116559 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-09276412-8aa3-40b1-bad9-c512ebe38b93 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:30.117309 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-09276412-8aa3-40b1-bad9-c512ebe38b93 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] [instance: 3e3afd4f-1acd-48ae-af4c-1e8d190dd313] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:30.124472 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-09276412-8aa3-40b1-bad9-c512ebe38b93 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:30.125296 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-09276412-8aa3-40b1-bad9-c512ebe38b93 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:30.126427 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-09276412-8aa3-40b1-bad9-c512ebe38b93 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:30.127313 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-09276412-8aa3-40b1-bad9-c512ebe38b93 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:30.142880 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-37a29afb-cd99-46a2-b2b6-b02042c9f3b6 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:30.142880 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-37a29afb-cd99-46a2-b2b6-b02042c9f3b6 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:30.150814 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-37a29afb-cd99-46a2-b2b6-b02042c9f3b6 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:30.151516 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-37a29afb-cd99-46a2-b2b6-b02042c9f3b6 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:30.153364 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-37a29afb-cd99-46a2-b2b6-b02042c9f3b6 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:30.157385 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-37a29afb-cd99-46a2-b2b6-b02042c9f3b6 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:30.511345 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-09276412-8aa3-40b1-bad9-c512ebe38b93 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848238e66f2e42de8eb36126ed103602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e1090f5bd4ef6bb01c960b5b89226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:30.524647 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-09276412-8aa3-40b1-bad9-c512ebe38b93 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313" status: 200 len: 1553 microversion: 2.1 time: 0.413627 Oct 28 12:31:30.525535 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 55/127] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:30 2021] GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313 => generated 1553 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:30.530234 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-37a29afb-cd99-46a2-b2b6-b02042c9f3b6 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:30.546291 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-37a29afb-cd99-46a2-b2b6-b02042c9f3b6 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1522 microversion: 2.1 time: 0.410455 Oct 28 12:31:30.562194 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-1d989706-9a87-44e3-a91f-c268e82e96ee tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:30.562907 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 73/128] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:30 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1522 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:30.569928 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-1d989706-9a87-44e3-a91f-c268e82e96ee tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:30.575744 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-bc7ac510-dc7e-4cd4-a3e0-18d1af0a6415 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:30.582461 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-bc7ac510-dc7e-4cd4-a3e0-18d1af0a6415 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:30.590865 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1d989706-9a87-44e3-a91f-c268e82e96ee tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:30.592038 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1d989706-9a87-44e3-a91f-c268e82e96ee tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:30.594982 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1d989706-9a87-44e3-a91f-c268e82e96ee tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:30.596281 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1d989706-9a87-44e3-a91f-c268e82e96ee tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:30.599940 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-bc7ac510-dc7e-4cd4-a3e0-18d1af0a6415 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:30.600545 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-bc7ac510-dc7e-4cd4-a3e0-18d1af0a6415 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:30.601597 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-bc7ac510-dc7e-4cd4-a3e0-18d1af0a6415 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:30.603649 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-bc7ac510-dc7e-4cd4-a3e0-18d1af0a6415 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:30.798740 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-bc7ac510-dc7e-4cd4-a3e0-18d1af0a6415 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 14 microversion: 2.20 time: 0.233184 Oct 28 12:31:30.803023 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 74/129] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:31:30 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 14 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:30.811586 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-b90290ab-788d-4bee-97aa-318dc107eca5 req-c261dff5-5e25-4b13-a334-3b5be018febf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6a3a830-8175-434e-8c23-336ccacf7ef8", "tag": "fd7216a9-4fe8-4770-a641-9f1115f86217"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:30.825005 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:31:30.825005 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:31:30.866180 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-1d989706-9a87-44e3-a91f-c268e82e96ee tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:30.871873 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-b90290ab-788d-4bee-97aa-318dc107eca5 req-c261dff5-5e25-4b13-a334-3b5be018febf service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:30.872302 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-b90290ab-788d-4bee-97aa-318dc107eca5 req-c261dff5-5e25-4b13-a334-3b5be018febf service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:30.876643 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-1d989706-9a87-44e3-a91f-c268e82e96ee tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1361 microversion: 2.1 time: 0.349563 Oct 28 12:31:30.877886 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 56/130] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:30 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1361 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:30.899282 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-b90290ab-788d-4bee-97aa-318dc107eca5 req-c261dff5-5e25-4b13-a334-3b5be018febf service nova] Creating event network-changed:fd7216a9-4fe8-4770-a641-9f1115f86217 for instance f6a3a830-8175-434e-8c23-336ccacf7ef8 on hv-cinder-81514 Oct 28 12:31:30.904609 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-b90290ab-788d-4bee-97aa-318dc107eca5 req-c261dff5-5e25-4b13-a334-3b5be018febf service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099652 Oct 28 12:31:30.905692 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 75/131] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:31:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:31:31.547414 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-b97bbf13-b3e7-4a6b-9481-1b866f58b582 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:31.549020 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-b97bbf13-b3e7-4a6b-9481-1b866f58b582 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] [instance: 3e3afd4f-1acd-48ae-af4c-1e8d190dd313] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:31.565692 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-d1c8683a-d237-485a-a604-1ef6453d309b tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:31.566587 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-d1c8683a-d237-485a-a604-1ef6453d309b tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:31.575553 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b97bbf13-b3e7-4a6b-9481-1b866f58b582 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:31.576268 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b97bbf13-b3e7-4a6b-9481-1b866f58b582 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:31.577773 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b97bbf13-b3e7-4a6b-9481-1b866f58b582 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:31.578077 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d1c8683a-d237-485a-a604-1ef6453d309b tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:31.578527 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d1c8683a-d237-485a-a604-1ef6453d309b tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:31.579206 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b97bbf13-b3e7-4a6b-9481-1b866f58b582 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:31.579387 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d1c8683a-d237-485a-a604-1ef6453d309b tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:31.579704 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d1c8683a-d237-485a-a604-1ef6453d309b tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:32.134349 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-b97bbf13-b3e7-4a6b-9481-1b866f58b582 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848238e66f2e42de8eb36126ed103602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e1090f5bd4ef6bb01c960b5b89226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:32.144846 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-d1c8683a-d237-485a-a604-1ef6453d309b tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:32.154148 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-d1c8683a-d237-485a-a604-1ef6453d309b tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1522 microversion: 2.1 time: 0.594069 Oct 28 12:31:32.155927 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 76/132] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:31 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1522 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:31:32.159963 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-5c7f7551-b3f7-4827-8801-8ebd364dd840 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:32.160384 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-b97bbf13-b3e7-4a6b-9481-1b866f58b582 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313" status: 200 len: 1553 microversion: 2.1 time: 0.620833 Oct 28 12:31:32.161261 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-5c7f7551-b3f7-4827-8801-8ebd364dd840 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:32.166483 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 57/133] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:31 2021] GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313 => generated 1553 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:31:32.176018 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5c7f7551-b3f7-4827-8801-8ebd364dd840 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:32.176245 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-8e851878-a0a1-4078-b0e1-4306808a6434 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:32.176865 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5c7f7551-b3f7-4827-8801-8ebd364dd840 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:32.177060 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-8e851878-a0a1-4078-b0e1-4306808a6434 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:32.177975 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5c7f7551-b3f7-4827-8801-8ebd364dd840 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:32.178469 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5c7f7551-b3f7-4827-8801-8ebd364dd840 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:32.195668 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8e851878-a0a1-4078-b0e1-4306808a6434 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:32.196193 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8e851878-a0a1-4078-b0e1-4306808a6434 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:32.197049 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8e851878-a0a1-4078-b0e1-4306808a6434 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:32.197467 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8e851878-a0a1-4078-b0e1-4306808a6434 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:32.270683 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-5c7f7551-b3f7-4827-8801-8ebd364dd840 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 14 microversion: 2.20 time: 0.111536 Oct 28 12:31:32.272284 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 77/134] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:31:32 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:32.425282 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-8e851878-a0a1-4078-b0e1-4306808a6434 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:32.434220 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-8e851878-a0a1-4078-b0e1-4306808a6434 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1547 microversion: 2.1 time: 0.268333 Oct 28 12:31:32.436196 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 58/135] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:32 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1547 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:32.453129 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-f41c4002-e002-4d3e-9d87-e45c4ec9bdec tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:32.453939 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-f41c4002-e002-4d3e-9d87-e45c4ec9bdec tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:32.461978 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f41c4002-e002-4d3e-9d87-e45c4ec9bdec tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:32.463129 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f41c4002-e002-4d3e-9d87-e45c4ec9bdec tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:32.464101 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f41c4002-e002-4d3e-9d87-e45c4ec9bdec tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:32.464820 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f41c4002-e002-4d3e-9d87-e45c4ec9bdec tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:32.577215 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-f41c4002-e002-4d3e-9d87-e45c4ec9bdec tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.128079 Oct 28 12:31:32.578785 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 78/136] 10.222.0.62 () {58 vars in 1274 bytes} [Thu Oct 28 12:31:32 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:31:33.183266 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-d35f38f2-ecdb-4a67-9578-1a61b1c6d27f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:33.184007 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-7dc1b894-3a0b-4d78-b7c4-e5ec7d28c632 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:33.185054 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-7dc1b894-3a0b-4d78-b7c4-e5ec7d28c632 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] [instance: 3e3afd4f-1acd-48ae-af4c-1e8d190dd313] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:33.185944 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-d35f38f2-ecdb-4a67-9578-1a61b1c6d27f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:33.199956 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7dc1b894-3a0b-4d78-b7c4-e5ec7d28c632 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:33.200307 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7dc1b894-3a0b-4d78-b7c4-e5ec7d28c632 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:33.201077 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7dc1b894-3a0b-4d78-b7c4-e5ec7d28c632 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:33.201502 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7dc1b894-3a0b-4d78-b7c4-e5ec7d28c632 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:33.205705 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d35f38f2-ecdb-4a67-9578-1a61b1c6d27f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:33.206145 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d35f38f2-ecdb-4a67-9578-1a61b1c6d27f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:33.207139 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d35f38f2-ecdb-4a67-9578-1a61b1c6d27f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:33.207751 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d35f38f2-ecdb-4a67-9578-1a61b1c6d27f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:33.393591 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-7dc1b894-3a0b-4d78-b7c4-e5ec7d28c632 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848238e66f2e42de8eb36126ed103602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e1090f5bd4ef6bb01c960b5b89226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:33.405167 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-7dc1b894-3a0b-4d78-b7c4-e5ec7d28c632 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313" status: 200 len: 1511 microversion: 2.1 time: 0.228308 Oct 28 12:31:33.406851 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 79/137] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:33 2021] GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313 => generated 1511 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:33.424977 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-4acf369c-1abb-4d4e-a5de-9ada79b1bc8a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:33.427513 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-4acf369c-1abb-4d4e-a5de-9ada79b1bc8a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:33.440930 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4acf369c-1abb-4d4e-a5de-9ada79b1bc8a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:33.441800 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4acf369c-1abb-4d4e-a5de-9ada79b1bc8a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:33.443283 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4acf369c-1abb-4d4e-a5de-9ada79b1bc8a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:33.444115 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4acf369c-1abb-4d4e-a5de-9ada79b1bc8a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:33.543468 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-4acf369c-1abb-4d4e-a5de-9ada79b1bc8a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 14 microversion: 2.20 time: 0.134689 Oct 28 12:31:33.544628 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 80/138] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:31:33 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:33.551674 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-8fa23525-3ca5-48eb-b114-d4aca86f1500 req-25f521c4-c8ca-47ad-8bbc-beddb1080d3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e3afd4f-1acd-48ae-af4c-1e8d190dd313", "name": "network-vif-deleted", "tag": "6b8de827-c643-404c-86f6-5c0f33960730"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:33.553863 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:31:33.553863 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:31:33.564244 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-8fa23525-3ca5-48eb-b114-d4aca86f1500 req-25f521c4-c8ca-47ad-8bbc-beddb1080d3c service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:33.565069 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-8fa23525-3ca5-48eb-b114-d4aca86f1500 req-25f521c4-c8ca-47ad-8bbc-beddb1080d3c service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:33.580582 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-8fa23525-3ca5-48eb-b114-d4aca86f1500 req-25f521c4-c8ca-47ad-8bbc-beddb1080d3c service nova] Creating event network-vif-deleted:6b8de827-c643-404c-86f6-5c0f33960730 for instance 3e3afd4f-1acd-48ae-af4c-1e8d190dd313 on hv-cinder-81514 Oct 28 12:31:33.588007 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-8fa23525-3ca5-48eb-b114-d4aca86f1500 req-25f521c4-c8ca-47ad-8bbc-beddb1080d3c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041040 Oct 28 12:31:33.589687 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 81/139] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:31:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:31:33.814594 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-d35f38f2-ecdb-4a67-9578-1a61b1c6d27f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:33.822166 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-d35f38f2-ecdb-4a67-9578-1a61b1c6d27f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1522 microversion: 2.1 time: 0.649247 Oct 28 12:31:33.832004 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 59/140] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:33 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1522 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:34.429627 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-be0e6f62-ee55-4cd3-be46-ae007d588fe5 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:34.431230 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-be0e6f62-ee55-4cd3-be46-ae007d588fe5 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] [instance: 3e3afd4f-1acd-48ae-af4c-1e8d190dd313] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:34.442802 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-be0e6f62-ee55-4cd3-be46-ae007d588fe5 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:34.443905 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-be0e6f62-ee55-4cd3-be46-ae007d588fe5 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:34.445476 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-be0e6f62-ee55-4cd3-be46-ae007d588fe5 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:34.446746 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-be0e6f62-ee55-4cd3-be46-ae007d588fe5 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:34.516675 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-be0e6f62-ee55-4cd3-be46-ae007d588fe5 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:34.517552 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-be0e6f62-ee55-4cd3-be46-ae007d588fe5 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:34.519321 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.objects.instance [None req-be0e6f62-ee55-4cd3-be46-ae007d588fe5 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lazy-loading 'fault' on Instance uuid 3e3afd4f-1acd-48ae-af4c-1e8d190dd313 {{(pid=115877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:31:34.547364 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-3de2cb39-ec19-40ca-a250-529258d46937 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:34.549819 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-3de2cb39-ec19-40ca-a250-529258d46937 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:34.581350 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3de2cb39-ec19-40ca-a250-529258d46937 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:34.582209 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3de2cb39-ec19-40ca-a250-529258d46937 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:34.583262 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3de2cb39-ec19-40ca-a250-529258d46937 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:34.584623 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3de2cb39-ec19-40ca-a250-529258d46937 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:34.595398 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-be0e6f62-ee55-4cd3-be46-ae007d588fe5 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848238e66f2e42de8eb36126ed103602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e1090f5bd4ef6bb01c960b5b89226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:34.604005 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-be0e6f62-ee55-4cd3-be46-ae007d588fe5 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313" status: 200 len: 1350 microversion: 2.1 time: 0.182735 Oct 28 12:31:34.605083 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 82/141] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:34 2021] GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313 => generated 1350 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:34.612970 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-947e972f-ea6d-46cc-9474-b9cd36de839f req-2edca11d-6e88-467c-8027-d6c45d2e9eea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b133627-e4a2-43dc-9613-8ef3d028862b", "tag": "fe4d3fd7-9134-42f8-a93d-9cbe08ca530e"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:34.614477 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:31:34.614477 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:31:34.628334 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-947e972f-ea6d-46cc-9474-b9cd36de839f req-2edca11d-6e88-467c-8027-d6c45d2e9eea service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:34.629135 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-947e972f-ea6d-46cc-9474-b9cd36de839f req-2edca11d-6e88-467c-8027-d6c45d2e9eea service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:34.642564 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-947e972f-ea6d-46cc-9474-b9cd36de839f req-2edca11d-6e88-467c-8027-d6c45d2e9eea service nova] Creating event network-changed:fe4d3fd7-9134-42f8-a93d-9cbe08ca530e for instance 1b133627-e4a2-43dc-9613-8ef3d028862b on hv-cinder-81514 Oct 28 12:31:34.647638 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-947e972f-ea6d-46cc-9474-b9cd36de839f req-2edca11d-6e88-467c-8027-d6c45d2e9eea service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041424 Oct 28 12:31:34.648291 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 83/142] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:31:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:31:34.655055 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-bec4fcdb-0367-471f-b33b-b91de7726c76 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:34.656623 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-bec4fcdb-0367-471f-b33b-b91de7726c76 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:34.663308 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-bec4fcdb-0367-471f-b33b-b91de7726c76 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:34.663908 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-bec4fcdb-0367-471f-b33b-b91de7726c76 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:34.664836 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-bec4fcdb-0367-471f-b33b-b91de7726c76 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:34.665275 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-bec4fcdb-0367-471f-b33b-b91de7726c76 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:37.422962 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-bec4fcdb-0367-471f-b33b-b91de7726c76 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 14 microversion: 2.20 time: 2.772875 Oct 28 12:31:37.423845 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 84/143] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:31:34 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 14 bytes in 2775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:37.428476 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-3de2cb39-ec19-40ca-a250-529258d46937 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 200 len: 14 microversion: 2.1 time: 2.887417 Oct 28 12:31:37.429729 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-02e28cfb-c280-4ff0-a4a2-b59a6e658fff tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:37.430164 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-02e28cfb-c280-4ff0-a4a2-b59a6e658fff tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:37.432188 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 60/144] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:31:34 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 14 bytes in 2893 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:31:37.437961 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-1ca3c247-1e8b-4197-ad23-bf8dee40872b tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:37.438697 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-1ca3c247-1e8b-4197-ad23-bf8dee40872b tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] [instance: 3e3afd4f-1acd-48ae-af4c-1e8d190dd313] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:37.440321 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-02e28cfb-c280-4ff0-a4a2-b59a6e658fff tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:37.440802 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-02e28cfb-c280-4ff0-a4a2-b59a6e658fff tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:37.441829 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-02e28cfb-c280-4ff0-a4a2-b59a6e658fff tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:37.441965 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-02e28cfb-c280-4ff0-a4a2-b59a6e658fff tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:37.445248 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1ca3c247-1e8b-4197-ad23-bf8dee40872b tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:37.445886 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1ca3c247-1e8b-4197-ad23-bf8dee40872b tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:37.447052 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1ca3c247-1e8b-4197-ad23-bf8dee40872b tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:37.447687 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1ca3c247-1e8b-4197-ad23-bf8dee40872b tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:37.486398 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1ca3c247-1e8b-4197-ad23-bf8dee40872b tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:37.486924 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1ca3c247-1e8b-4197-ad23-bf8dee40872b tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:37.487504 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.objects.instance [None req-1ca3c247-1e8b-4197-ad23-bf8dee40872b tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lazy-loading 'fault' on Instance uuid 3e3afd4f-1acd-48ae-af4c-1e8d190dd313 {{(pid=115876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:31:37.545327 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-1ca3c247-1e8b-4197-ad23-bf8dee40872b tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848238e66f2e42de8eb36126ed103602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e1090f5bd4ef6bb01c960b5b89226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:37.553531 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-1ca3c247-1e8b-4197-ad23-bf8dee40872b tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313" status: 200 len: 1304 microversion: 2.1 time: 0.119946 Oct 28 12:31:37.554099 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 61/145] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:37 2021] GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313 => generated 1304 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:37.614205 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-02e28cfb-c280-4ff0-a4a2-b59a6e658fff tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:37.622887 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-02e28cfb-c280-4ff0-a4a2-b59a6e658fff tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1522 microversion: 2.1 time: 0.197820 Oct 28 12:31:37.623494 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 85/146] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:37 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:38.434970 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-df018213-ef2e-4164-b729-ff16430f961b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:38.436302 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-df018213-ef2e-4164-b729-ff16430f961b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:38.439603 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-a0950a50-e735-4df6-83a0-b2b5a869baa3 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:38.441059 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-a0950a50-e735-4df6-83a0-b2b5a869baa3 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:38.443311 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-df018213-ef2e-4164-b729-ff16430f961b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:38.444000 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-df018213-ef2e-4164-b729-ff16430f961b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:38.445838 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-df018213-ef2e-4164-b729-ff16430f961b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:38.446085 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-df018213-ef2e-4164-b729-ff16430f961b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:38.448182 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a0950a50-e735-4df6-83a0-b2b5a869baa3 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:38.448973 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a0950a50-e735-4df6-83a0-b2b5a869baa3 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:38.450428 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a0950a50-e735-4df6-83a0-b2b5a869baa3 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:38.451163 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a0950a50-e735-4df6-83a0-b2b5a869baa3 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:38.550709 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-a0950a50-e735-4df6-83a0-b2b5a869baa3 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 200 len: 14 microversion: 2.1 time: 0.114557 Oct 28 12:31:38.551502 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 86/147] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:31:38 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 12:31:38.566967 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-df018213-ef2e-4164-b729-ff16430f961b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 14 microversion: 2.20 time: 0.135648 Oct 28 12:31:38.567573 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 62/148] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:31:38 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:38.572028 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-c3149be0-cfe1-4229-825d-796a4a6f68f5 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:38.572783 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-c3149be0-cfe1-4229-825d-796a4a6f68f5 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] [instance: 3e3afd4f-1acd-48ae-af4c-1e8d190dd313] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:38.580644 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c3149be0-cfe1-4229-825d-796a4a6f68f5 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:38.581103 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c3149be0-cfe1-4229-825d-796a4a6f68f5 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:38.581862 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c3149be0-cfe1-4229-825d-796a4a6f68f5 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:38.582286 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c3149be0-cfe1-4229-825d-796a4a6f68f5 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:38.596416 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.wsgi [None req-c3149be0-cfe1-4229-825d-796a4a6f68f5 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] HTTP exception thrown: Instance 3e3afd4f-1acd-48ae-af4c-1e8d190dd313 could not be found. Oct 28 12:31:38.597077 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-c3149be0-cfe1-4229-825d-796a4a6f68f5 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Returning 404 to user: Instance 3e3afd4f-1acd-48ae-af4c-1e8d190dd313 could not be found. {{(pid=115877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:31:38.597906 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-c3149be0-cfe1-4229-825d-796a4a6f68f5 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313" status: 404 len: 111 microversion: 2.1 time: 0.030469 Oct 28 12:31:38.598688 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 87/149] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:38 2021] GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:31:38.645249 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-748cdeaa-8f8f-4752-a685-beadcf3d992a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:38.645249 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-748cdeaa-8f8f-4752-a685-beadcf3d992a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:38.654321 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-748cdeaa-8f8f-4752-a685-beadcf3d992a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:38.655282 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-748cdeaa-8f8f-4752-a685-beadcf3d992a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:38.655912 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-748cdeaa-8f8f-4752-a685-beadcf3d992a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:38.656334 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-748cdeaa-8f8f-4752-a685-beadcf3d992a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:38.717245 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-71025ea4-d164-4671-967a-bb7c29050833 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:38.718212 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-71025ea4-d164-4671-967a-bb7c29050833 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] [instance: 3e3afd4f-1acd-48ae-af4c-1e8d190dd313] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:38.727258 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-71025ea4-d164-4671-967a-bb7c29050833 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:38.727703 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-71025ea4-d164-4671-967a-bb7c29050833 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:38.728479 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-71025ea4-d164-4671-967a-bb7c29050833 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:38.729102 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-71025ea4-d164-4671-967a-bb7c29050833 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:38.751809 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.wsgi [None req-71025ea4-d164-4671-967a-bb7c29050833 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] HTTP exception thrown: Instance 3e3afd4f-1acd-48ae-af4c-1e8d190dd313 could not be found. Oct 28 12:31:38.752625 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-71025ea4-d164-4671-967a-bb7c29050833 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Returning 404 to user: Instance 3e3afd4f-1acd-48ae-af4c-1e8d190dd313 could not be found. {{(pid=115877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:31:38.753648 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-71025ea4-d164-4671-967a-bb7c29050833 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040371 Oct 28 12:31:38.754419 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 88/150] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Oct 28 12:31:38 2021] GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 12:31:38.806561 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-748cdeaa-8f8f-4752-a685-beadcf3d992a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:38.816534 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-748cdeaa-8f8f-4752-a685-beadcf3d992a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1522 microversion: 2.1 time: 0.178842 Oct 28 12:31:38.817458 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 63/151] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:38 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:39.569649 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-b19fe368-8594-4892-b786-5fd9fa25b878 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:39.569649 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-b19fe368-8594-4892-b786-5fd9fa25b878 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:39.570797 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b19fe368-8594-4892-b786-5fd9fa25b878 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:39.571227 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b19fe368-8594-4892-b786-5fd9fa25b878 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:39.571999 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b19fe368-8594-4892-b786-5fd9fa25b878 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:39.572936 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b19fe368-8594-4892-b786-5fd9fa25b878 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:39.578049 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-8a42036a-6274-4fc6-8717-b056acf8db65 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:39.579437 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-8a42036a-6274-4fc6-8717-b056acf8db65 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:39.586733 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8a42036a-6274-4fc6-8717-b056acf8db65 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:39.587292 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8a42036a-6274-4fc6-8717-b056acf8db65 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:39.588015 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8a42036a-6274-4fc6-8717-b056acf8db65 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:39.588702 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8a42036a-6274-4fc6-8717-b056acf8db65 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:39.659379 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-b19fe368-8594-4892-b786-5fd9fa25b878 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 200 len: 14 microversion: 2.1 time: 0.100889 Oct 28 12:31:39.660020 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 89/152] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:31:39 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:31:39.662488 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-8a42036a-6274-4fc6-8717-b056acf8db65 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 14 microversion: 2.20 time: 0.087818 Oct 28 12:31:39.663385 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 64/153] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:31:39 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:39.837068 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-b72f803d-01e1-4069-ac31-fa99aa552987 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:39.837994 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-b72f803d-01e1-4069-ac31-fa99aa552987 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:39.848329 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b72f803d-01e1-4069-ac31-fa99aa552987 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:39.849073 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b72f803d-01e1-4069-ac31-fa99aa552987 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:39.850078 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b72f803d-01e1-4069-ac31-fa99aa552987 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:39.850785 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b72f803d-01e1-4069-ac31-fa99aa552987 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:39.975867 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-d06f5d16-ac95-4d11-b667-a46aab43c764 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:39.976850 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-d06f5d16-ac95-4d11-b667-a46aab43c764 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] [instance: 3e3afd4f-1acd-48ae-af4c-1e8d190dd313] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:39.984990 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d06f5d16-ac95-4d11-b667-a46aab43c764 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:39.985433 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d06f5d16-ac95-4d11-b667-a46aab43c764 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:39.986205 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d06f5d16-ac95-4d11-b667-a46aab43c764 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:39.986633 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d06f5d16-ac95-4d11-b667-a46aab43c764 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:40.001658 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.wsgi [None req-d06f5d16-ac95-4d11-b667-a46aab43c764 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] HTTP exception thrown: Instance 3e3afd4f-1acd-48ae-af4c-1e8d190dd313 could not be found. Oct 28 12:31:40.002437 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-d06f5d16-ac95-4d11-b667-a46aab43c764 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Returning 404 to user: Instance 3e3afd4f-1acd-48ae-af4c-1e8d190dd313 could not be found. {{(pid=115876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:31:40.003339 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-d06f5d16-ac95-4d11-b667-a46aab43c764 tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] 10.222.0.62 "DELETE /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313" status: 404 len: 111 microversion: 2.1 time: 0.033031 Oct 28 12:31:40.006731 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 65/154] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Oct 28 12:31:39 2021] DELETE /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:31:40.011572 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-43b75591-46cf-47db-bb76-8c7e7b39630e tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:40.012180 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-43b75591-46cf-47db-bb76-8c7e7b39630e tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] [instance: 3e3afd4f-1acd-48ae-af4c-1e8d190dd313] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:40.018395 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-b72f803d-01e1-4069-ac31-fa99aa552987 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:40.018555 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-43b75591-46cf-47db-bb76-8c7e7b39630e tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:40.018917 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-43b75591-46cf-47db-bb76-8c7e7b39630e tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:40.019683 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-43b75591-46cf-47db-bb76-8c7e7b39630e tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:40.020109 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-43b75591-46cf-47db-bb76-8c7e7b39630e tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:40.038327 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-b72f803d-01e1-4069-ac31-fa99aa552987 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1522 microversion: 2.1 time: 0.205404 Oct 28 12:31:40.039516 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 90/155] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:39 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:40.046545 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.wsgi [None req-43b75591-46cf-47db-bb76-8c7e7b39630e tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] HTTP exception thrown: Instance 3e3afd4f-1acd-48ae-af4c-1e8d190dd313 could not be found. Oct 28 12:31:40.047192 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-43b75591-46cf-47db-bb76-8c7e7b39630e tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] Returning 404 to user: Instance 3e3afd4f-1acd-48ae-af4c-1e8d190dd313 could not be found. {{(pid=115876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:31:40.048142 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-43b75591-46cf-47db-bb76-8c7e7b39630e tempest-DeleteServersTestJSON-1431514800 tempest-DeleteServersTestJSON-1431514800-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313" status: 404 len: 111 microversion: 2.1 time: 0.040374 Oct 28 12:31:40.048896 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 66/156] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:40 2021] GET /compute/v2.1/servers/3e3afd4f-1acd-48ae-af4c-1e8d190dd313 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:31:40.681185 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-1e65cc0c-6c07-4f76-afc3-4501181673c0 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:40.691356 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-12ba0bf4-323f-4290-a388-7bbc42a711fb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:40.694625 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-12ba0bf4-323f-4290-a388-7bbc42a711fb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:40.695217 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-1e65cc0c-6c07-4f76-afc3-4501181673c0 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:40.718957 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1e65cc0c-6c07-4f76-afc3-4501181673c0 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:40.719986 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1e65cc0c-6c07-4f76-afc3-4501181673c0 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:40.721159 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-12ba0bf4-323f-4290-a388-7bbc42a711fb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:40.721919 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-12ba0bf4-323f-4290-a388-7bbc42a711fb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:40.723313 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-12ba0bf4-323f-4290-a388-7bbc42a711fb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:40.724047 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-12ba0bf4-323f-4290-a388-7bbc42a711fb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:40.726379 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1e65cc0c-6c07-4f76-afc3-4501181673c0 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:40.727173 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1e65cc0c-6c07-4f76-afc3-4501181673c0 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:40.849475 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-1e65cc0c-6c07-4f76-afc3-4501181673c0 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 200 len: 14 microversion: 2.1 time: 0.182045 Oct 28 12:31:40.850356 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 91/157] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:31:40 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 14 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:31:40.868013 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-12ba0bf4-323f-4290-a388-7bbc42a711fb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 14 microversion: 2.20 time: 0.196271 Oct 28 12:31:40.873483 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 67/158] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:31:40 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 14 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:41.057801 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-6fd0e540-9bbf-4ea7-b203-28eb0f2e9d7c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:41.058941 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-6fd0e540-9bbf-4ea7-b203-28eb0f2e9d7c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:41.082402 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6fd0e540-9bbf-4ea7-b203-28eb0f2e9d7c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:41.083013 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6fd0e540-9bbf-4ea7-b203-28eb0f2e9d7c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:41.083887 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6fd0e540-9bbf-4ea7-b203-28eb0f2e9d7c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:41.084321 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6fd0e540-9bbf-4ea7-b203-28eb0f2e9d7c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:41.255381 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-6fd0e540-9bbf-4ea7-b203-28eb0f2e9d7c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:41.264747 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-6fd0e540-9bbf-4ea7-b203-28eb0f2e9d7c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1522 microversion: 2.1 time: 0.212691 Oct 28 12:31:41.274334 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 92/159] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:41 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:41.865976 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-e3af5a83-8fae-49d6-a228-60b54dd163d8 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:41.865976 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-e3af5a83-8fae-49d6-a228-60b54dd163d8 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:41.873564 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e3af5a83-8fae-49d6-a228-60b54dd163d8 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:41.880773 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e3af5a83-8fae-49d6-a228-60b54dd163d8 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:41.881894 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-f76798c4-beea-4976-a9d9-8aa742afec35 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:41.882855 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-f76798c4-beea-4976-a9d9-8aa742afec35 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:41.883395 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e3af5a83-8fae-49d6-a228-60b54dd163d8 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:41.884043 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e3af5a83-8fae-49d6-a228-60b54dd163d8 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:41.891493 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f76798c4-beea-4976-a9d9-8aa742afec35 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:41.892120 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f76798c4-beea-4976-a9d9-8aa742afec35 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:41.893017 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f76798c4-beea-4976-a9d9-8aa742afec35 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:41.893464 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f76798c4-beea-4976-a9d9-8aa742afec35 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:41.956486 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-e3af5a83-8fae-49d6-a228-60b54dd163d8 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 200 len: 14 microversion: 2.1 time: 0.097550 Oct 28 12:31:41.957255 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 68/160] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:31:41 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:31:41.971683 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-f76798c4-beea-4976-a9d9-8aa742afec35 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 14 microversion: 2.20 time: 0.094260 Oct 28 12:31:41.975033 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 93/161] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:31:41 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:31:42.284226 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-7819c80f-ff4c-4e8e-8354-4587ea1cb5b7 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:42.285263 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-7819c80f-ff4c-4e8e-8354-4587ea1cb5b7 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:42.292800 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7819c80f-ff4c-4e8e-8354-4587ea1cb5b7 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:42.293348 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7819c80f-ff4c-4e8e-8354-4587ea1cb5b7 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:42.294642 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7819c80f-ff4c-4e8e-8354-4587ea1cb5b7 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:42.295286 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7819c80f-ff4c-4e8e-8354-4587ea1cb5b7 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:42.442043 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-7819c80f-ff4c-4e8e-8354-4587ea1cb5b7 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:42.452040 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-7819c80f-ff4c-4e8e-8354-4587ea1cb5b7 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1522 microversion: 2.1 time: 0.172786 Oct 28 12:31:42.462842 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 69/162] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:42 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:42.968518 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-9913c1eb-d2b6-4f6a-8270-47420f1b16e9 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:42.970831 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-9913c1eb-d2b6-4f6a-8270-47420f1b16e9 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:42.980331 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9913c1eb-d2b6-4f6a-8270-47420f1b16e9 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:42.981176 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9913c1eb-d2b6-4f6a-8270-47420f1b16e9 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:42.982189 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9913c1eb-d2b6-4f6a-8270-47420f1b16e9 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:42.983048 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9913c1eb-d2b6-4f6a-8270-47420f1b16e9 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:42.984426 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-5eff6d90-fdea-4373-bb9d-d801c611d495 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:42.986017 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-5eff6d90-fdea-4373-bb9d-d801c611d495 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:42.993460 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5eff6d90-fdea-4373-bb9d-d801c611d495 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:42.993913 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5eff6d90-fdea-4373-bb9d-d801c611d495 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:42.994739 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5eff6d90-fdea-4373-bb9d-d801c611d495 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:42.995218 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5eff6d90-fdea-4373-bb9d-d801c611d495 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:43.072130 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-9913c1eb-d2b6-4f6a-8270-47420f1b16e9 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 200 len: 14 microversion: 2.1 time: 0.107972 Oct 28 12:31:43.075546 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 94/163] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:31:42 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:31:43.091986 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-5eff6d90-fdea-4373-bb9d-d801c611d495 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 14 microversion: 2.20 time: 0.111969 Oct 28 12:31:43.095559 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 70/164] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:31:42 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:31:43.470257 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-06df1868-3245-40f0-95f6-e7e47df86e86 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:43.471350 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-06df1868-3245-40f0-95f6-e7e47df86e86 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:43.478877 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-06df1868-3245-40f0-95f6-e7e47df86e86 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:43.479325 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-06df1868-3245-40f0-95f6-e7e47df86e86 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:43.480363 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-06df1868-3245-40f0-95f6-e7e47df86e86 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:43.481044 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-06df1868-3245-40f0-95f6-e7e47df86e86 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:43.919716 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-06df1868-3245-40f0-95f6-e7e47df86e86 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:43.931497 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-06df1868-3245-40f0-95f6-e7e47df86e86 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1522 microversion: 2.1 time: 0.464139 Oct 28 12:31:43.939227 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 95/165] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:43 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1522 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:44.084402 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-fc77cce4-855a-4196-878e-270233dc94f5 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:44.086929 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-fc77cce4-855a-4196-878e-270233dc94f5 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:44.105573 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-8fd3f46e-4b7a-499c-8dba-638204dd636b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:44.108238 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-8fd3f46e-4b7a-499c-8dba-638204dd636b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:44.115690 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fc77cce4-855a-4196-878e-270233dc94f5 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:44.118214 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fc77cce4-855a-4196-878e-270233dc94f5 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:44.120738 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fc77cce4-855a-4196-878e-270233dc94f5 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:44.122209 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fc77cce4-855a-4196-878e-270233dc94f5 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:44.127509 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8fd3f46e-4b7a-499c-8dba-638204dd636b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:44.127941 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8fd3f46e-4b7a-499c-8dba-638204dd636b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:44.130314 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8fd3f46e-4b7a-499c-8dba-638204dd636b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:44.131544 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8fd3f46e-4b7a-499c-8dba-638204dd636b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:44.243896 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-8fd3f46e-4b7a-499c-8dba-638204dd636b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 14 microversion: 2.20 time: 0.143763 Oct 28 12:31:44.250181 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-fc77cce4-855a-4196-878e-270233dc94f5 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 200 len: 14 microversion: 2.1 time: 0.170352 Oct 28 12:31:44.251612 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 71/166] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:31:44 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 14 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:31:44.255196 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 96/167] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:31:44 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:31:44.955906 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-1ac1fb4b-9c4c-444c-bf11-b468241a050b tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:44.956588 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-1ac1fb4b-9c4c-444c-bf11-b468241a050b tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:44.967540 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1ac1fb4b-9c4c-444c-bf11-b468241a050b tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:44.967980 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1ac1fb4b-9c4c-444c-bf11-b468241a050b tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:44.968755 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1ac1fb4b-9c4c-444c-bf11-b468241a050b tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:44.969183 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1ac1fb4b-9c4c-444c-bf11-b468241a050b tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:45.227769 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-1ac1fb4b-9c4c-444c-bf11-b468241a050b tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:45.238917 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-1ac1fb4b-9c4c-444c-bf11-b468241a050b tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1522 microversion: 2.1 time: 0.286919 Oct 28 12:31:45.241444 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 72/168] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:44 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:45.255023 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-4a926e45-d837-4fab-a2ab-88e4583ba340 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:45.257957 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-4a926e45-d837-4fab-a2ab-88e4583ba340 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:45.261935 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-26324350-2b6d-4ce0-a16c-1e40ca8ba07d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:45.262885 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-26324350-2b6d-4ce0-a16c-1e40ca8ba07d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:45.273395 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4a926e45-d837-4fab-a2ab-88e4583ba340 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:45.274245 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4a926e45-d837-4fab-a2ab-88e4583ba340 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:45.275306 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4a926e45-d837-4fab-a2ab-88e4583ba340 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:45.275675 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-26324350-2b6d-4ce0-a16c-1e40ca8ba07d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:45.276096 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4a926e45-d837-4fab-a2ab-88e4583ba340 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:45.276200 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-26324350-2b6d-4ce0-a16c-1e40ca8ba07d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:45.277457 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-26324350-2b6d-4ce0-a16c-1e40ca8ba07d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:45.277900 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-26324350-2b6d-4ce0-a16c-1e40ca8ba07d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:45.348478 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-26324350-2b6d-4ce0-a16c-1e40ca8ba07d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 200 len: 14 microversion: 2.1 time: 0.089818 Oct 28 12:31:45.349459 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 73/169] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:31:45 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 12:31:45.404423 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-4a926e45-d837-4fab-a2ab-88e4583ba340 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 10893 microversion: 2.20 time: 0.153690 Oct 28 12:31:45.405408 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 97/170] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:31:45 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 10893 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:31:46.261819 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-84a8776e-bdba-46be-a74c-1c4c241808f0 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:46.262920 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-84a8776e-bdba-46be-a74c-1c4c241808f0 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:46.273998 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-84a8776e-bdba-46be-a74c-1c4c241808f0 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:46.274926 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-84a8776e-bdba-46be-a74c-1c4c241808f0 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:46.275951 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-84a8776e-bdba-46be-a74c-1c4c241808f0 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:46.276389 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-84a8776e-bdba-46be-a74c-1c4c241808f0 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:46.363899 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-1cca87ee-b6a3-4f97-b109-dfb435956f07 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:46.366182 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-1cca87ee-b6a3-4f97-b109-dfb435956f07 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:46.379653 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1cca87ee-b6a3-4f97-b109-dfb435956f07 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:46.383964 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1cca87ee-b6a3-4f97-b109-dfb435956f07 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:46.385550 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1cca87ee-b6a3-4f97-b109-dfb435956f07 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:46.387428 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1cca87ee-b6a3-4f97-b109-dfb435956f07 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:46.479909 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-1cca87ee-b6a3-4f97-b109-dfb435956f07 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 200 len: 14 microversion: 2.1 time: 0.123322 Oct 28 12:31:46.483964 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 98/171] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:31:46 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:31:46.496780 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-62b73956-64b5-4122-a2be-6968e2ce83fd tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:46.499281 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-62b73956-64b5-4122-a2be-6968e2ce83fd tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:46.516508 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-62b73956-64b5-4122-a2be-6968e2ce83fd tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:46.521147 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-62b73956-64b5-4122-a2be-6968e2ce83fd tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:46.524230 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-62b73956-64b5-4122-a2be-6968e2ce83fd tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:46.525603 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-62b73956-64b5-4122-a2be-6968e2ce83fd tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:46.653188 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-62b73956-64b5-4122-a2be-6968e2ce83fd tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 15577 microversion: 2.20 time: 0.166327 Oct 28 12:31:46.653671 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 99/172] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:31:46 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 15577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:31:46.779378 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-84a8776e-bdba-46be-a74c-1c4c241808f0 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:46.802899 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-84a8776e-bdba-46be-a74c-1c4c241808f0 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1522 microversion: 2.1 time: 0.547953 Oct 28 12:31:46.803497 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 74/173] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:46 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1522 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:47.493755 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-22379bad-ed26-4fcb-b2ae-2201c7483ee7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:47.495476 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-22379bad-ed26-4fcb-b2ae-2201c7483ee7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:47.513090 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-22379bad-ed26-4fcb-b2ae-2201c7483ee7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:47.514118 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-22379bad-ed26-4fcb-b2ae-2201c7483ee7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:47.515707 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-22379bad-ed26-4fcb-b2ae-2201c7483ee7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:47.516649 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-22379bad-ed26-4fcb-b2ae-2201c7483ee7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:47.631697 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-22379bad-ed26-4fcb-b2ae-2201c7483ee7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 200 len: 6451 microversion: 2.1 time: 0.142799 Oct 28 12:31:47.632433 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 100/174] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:31:47 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 6451 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:47.664216 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-1a3a6f42-50b1-4585-8094-fe774928dc4c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:47.665967 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-1a3a6f42-50b1-4585-8094-fe774928dc4c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:47.678147 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1a3a6f42-50b1-4585-8094-fe774928dc4c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:47.678631 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1a3a6f42-50b1-4585-8094-fe774928dc4c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:47.679475 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1a3a6f42-50b1-4585-8094-fe774928dc4c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:47.684246 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1a3a6f42-50b1-4585-8094-fe774928dc4c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:47.805754 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-1a3a6f42-50b1-4585-8094-fe774928dc4c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 17960 microversion: 2.20 time: 0.145060 Oct 28 12:31:47.806761 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 75/175] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:31:47 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 17960 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:31:47.820991 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-66e72b54-3fd8-4cb3-8fc2-e8f15338aa6b tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:47.821711 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-66e72b54-3fd8-4cb3-8fc2-e8f15338aa6b tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:47.837736 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-66e72b54-3fd8-4cb3-8fc2-e8f15338aa6b tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:47.838175 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-66e72b54-3fd8-4cb3-8fc2-e8f15338aa6b tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:47.839062 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-66e72b54-3fd8-4cb3-8fc2-e8f15338aa6b tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:47.839488 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-66e72b54-3fd8-4cb3-8fc2-e8f15338aa6b tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:48.177350 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-66e72b54-3fd8-4cb3-8fc2-e8f15338aa6b tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:48.194562 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-66e72b54-3fd8-4cb3-8fc2-e8f15338aa6b tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1522 microversion: 2.1 time: 0.377701 Oct 28 12:31:48.212833 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 101/176] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:47 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:48.645991 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-e9ed384b-ee39-48d2-95b1-a7ae99019cff tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:48.647433 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-e9ed384b-ee39-48d2-95b1-a7ae99019cff tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:48.679409 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e9ed384b-ee39-48d2-95b1-a7ae99019cff tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:48.680135 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e9ed384b-ee39-48d2-95b1-a7ae99019cff tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:48.682969 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e9ed384b-ee39-48d2-95b1-a7ae99019cff tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:48.683454 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e9ed384b-ee39-48d2-95b1-a7ae99019cff tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:48.821884 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-e9ed384b-ee39-48d2-95b1-a7ae99019cff tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 200 len: 12758 microversion: 2.1 time: 0.180733 Oct 28 12:31:48.823925 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 76/177] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:31:48 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 12758 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:31:48.825383 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-25096603-2a4a-4187-a7c9-48d1633a8027 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:48.830372 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-25096603-2a4a-4187-a7c9-48d1633a8027 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:48.849710 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-25096603-2a4a-4187-a7c9-48d1633a8027 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:48.852413 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-25096603-2a4a-4187-a7c9-48d1633a8027 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:48.857900 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-25096603-2a4a-4187-a7c9-48d1633a8027 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:48.858345 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-25096603-2a4a-4187-a7c9-48d1633a8027 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:48.977289 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-25096603-2a4a-4187-a7c9-48d1633a8027 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 19342 microversion: 2.20 time: 0.160133 Oct 28 12:31:48.980114 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 102/178] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:31:48 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 19342 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:31:49.215671 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-ce60cfdf-9066-4e48-a535-3ae68b8ce487 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:49.216676 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-ce60cfdf-9066-4e48-a535-3ae68b8ce487 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:49.231311 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ce60cfdf-9066-4e48-a535-3ae68b8ce487 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:49.231752 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ce60cfdf-9066-4e48-a535-3ae68b8ce487 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:49.238486 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ce60cfdf-9066-4e48-a535-3ae68b8ce487 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:49.251567 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ce60cfdf-9066-4e48-a535-3ae68b8ce487 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:49.600183 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-ce60cfdf-9066-4e48-a535-3ae68b8ce487 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:49.620067 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-ce60cfdf-9066-4e48-a535-3ae68b8ce487 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1502 microversion: 2.1 time: 0.407908 Oct 28 12:31:49.621261 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 77/179] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:49 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1502 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:49.650792 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-34f099d5-4528-492b-9bb9-7753ad7d0f57 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:49.651497 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-34f099d5-4528-492b-9bb9-7753ad7d0f57 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:49.669323 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-34f099d5-4528-492b-9bb9-7753ad7d0f57 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:49.669747 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-34f099d5-4528-492b-9bb9-7753ad7d0f57 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:49.670768 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-34f099d5-4528-492b-9bb9-7753ad7d0f57 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:49.671385 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-34f099d5-4528-492b-9bb9-7753ad7d0f57 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:49.834447 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-8aefc483-7a69-4f81-9309-37a982f8cf01 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:49.835391 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-8aefc483-7a69-4f81-9309-37a982f8cf01 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:49.851750 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8aefc483-7a69-4f81-9309-37a982f8cf01 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:49.852314 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8aefc483-7a69-4f81-9309-37a982f8cf01 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:49.853080 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8aefc483-7a69-4f81-9309-37a982f8cf01 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:49.853673 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8aefc483-7a69-4f81-9309-37a982f8cf01 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:49.957110 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-34f099d5-4528-492b-9bb9-7753ad7d0f57 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:49.965628 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-34f099d5-4528-492b-9bb9-7753ad7d0f57 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1514 microversion: 2.1 time: 0.319364 Oct 28 12:31:49.981803 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 103/180] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:49 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1514 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:49.981983 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-8aefc483-7a69-4f81-9309-37a982f8cf01 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 200 len: 17354 microversion: 2.1 time: 0.151244 Oct 28 12:31:49.982736 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 78/181] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:31:49 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 17354 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:31:49.995727 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-3700befb-6cd0-4729-b670-a06bd5e0dcdd tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:49.999083 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-3700befb-6cd0-4729-b670-a06bd5e0dcdd tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:50.013987 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3700befb-6cd0-4729-b670-a06bd5e0dcdd tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:50.016837 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3700befb-6cd0-4729-b670-a06bd5e0dcdd tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:50.017949 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3700befb-6cd0-4729-b670-a06bd5e0dcdd tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:50.019736 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3700befb-6cd0-4729-b670-a06bd5e0dcdd tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:50.152461 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-3700befb-6cd0-4729-b670-a06bd5e0dcdd tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 21519 microversion: 2.20 time: 0.164794 Oct 28 12:31:50.162205 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 104/182] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:31:49 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 21519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:31:50.998230 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-fff2c0da-1065-42fb-8c06-669a77fa3905 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:50.999403 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-fff2c0da-1065-42fb-8c06-669a77fa3905 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:51.012771 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fff2c0da-1065-42fb-8c06-669a77fa3905 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:51.016093 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fff2c0da-1065-42fb-8c06-669a77fa3905 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:51.019388 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fff2c0da-1065-42fb-8c06-669a77fa3905 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:51.020917 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fff2c0da-1065-42fb-8c06-669a77fa3905 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:51.161695 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-fff2c0da-1065-42fb-8c06-669a77fa3905 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 200 len: 18449 microversion: 2.1 time: 0.169413 Oct 28 12:31:51.165836 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 79/183] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:31:50 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 18449 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:31:51.176314 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-ac5c37ad-3db7-4b54-8be2-02115b69f790 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:51.177637 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-ac5c37ad-3db7-4b54-8be2-02115b69f790 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:51.186148 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ac5c37ad-3db7-4b54-8be2-02115b69f790 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:51.186602 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ac5c37ad-3db7-4b54-8be2-02115b69f790 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:51.187373 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ac5c37ad-3db7-4b54-8be2-02115b69f790 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:51.187794 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ac5c37ad-3db7-4b54-8be2-02115b69f790 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:51.303484 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-ac5c37ad-3db7-4b54-8be2-02115b69f790 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 22988 microversion: 2.20 time: 0.132278 Oct 28 12:31:51.304606 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 105/184] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:31:51 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 22988 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:31:51.880913 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-3df024c4-6b5c-48df-9c05-782bdfda1779 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:51.882192 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-3df024c4-6b5c-48df-9c05-782bdfda1779 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:51.897299 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3df024c4-6b5c-48df-9c05-782bdfda1779 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:51.897746 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3df024c4-6b5c-48df-9c05-782bdfda1779 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:51.898555 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3df024c4-6b5c-48df-9c05-782bdfda1779 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:51.898988 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3df024c4-6b5c-48df-9c05-782bdfda1779 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:51.925508 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.objects.instance [None req-3df024c4-6b5c-48df-9c05-782bdfda1779 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lazy-loading 'flavor' on Instance uuid 358e5707-b5af-4ff5-9308-489054458c20 {{(pid=115876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:31:52.031379 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-3df024c4-6b5c-48df-9c05-782bdfda1779 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "POST /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20/action" status: 200 len: 32 microversion: 2.1 time: 0.155459 Oct 28 12:31:52.032175 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 80/185] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:31:51 2021] POST /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20/action => generated 32 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 12:31:52.044981 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-4a728005-197e-47fa-b1ea-cf22da68e869 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:52.045785 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-4a728005-197e-47fa-b1ea-cf22da68e869 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:52.056531 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4a728005-197e-47fa-b1ea-cf22da68e869 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:52.057172 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4a728005-197e-47fa-b1ea-cf22da68e869 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:52.058054 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4a728005-197e-47fa-b1ea-cf22da68e869 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:52.058552 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4a728005-197e-47fa-b1ea-cf22da68e869 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:52.175092 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-b1b3c591-c7af-4850-8472-e50850dccb6c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:52.176028 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-b1b3c591-c7af-4850-8472-e50850dccb6c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:52.190910 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b1b3c591-c7af-4850-8472-e50850dccb6c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:52.191623 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b1b3c591-c7af-4850-8472-e50850dccb6c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:52.193684 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b1b3c591-c7af-4850-8472-e50850dccb6c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:52.195691 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b1b3c591-c7af-4850-8472-e50850dccb6c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:52.296132 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-4a728005-197e-47fa-b1ea-cf22da68e869 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:52.305857 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-4a728005-197e-47fa-b1ea-cf22da68e869 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1520 microversion: 2.1 time: 0.267618 Oct 28 12:31:52.307171 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 106/186] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:52 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1520 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:31:52.315869 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-b1b3c591-c7af-4850-8472-e50850dccb6c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 200 len: 20991 microversion: 2.1 time: 0.145474 Oct 28 12:31:52.319812 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 81/187] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:31:52 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 20991 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:31:52.322321 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-06a85da4-ba9e-4ec1-9701-9ea7e770cea3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:52.329837 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-06a85da4-ba9e-4ec1-9701-9ea7e770cea3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:52.346392 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-06a85da4-ba9e-4ec1-9701-9ea7e770cea3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:52.348544 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-06a85da4-ba9e-4ec1-9701-9ea7e770cea3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:52.349520 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-06a85da4-ba9e-4ec1-9701-9ea7e770cea3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:52.351534 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-06a85da4-ba9e-4ec1-9701-9ea7e770cea3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:52.500977 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-06a85da4-ba9e-4ec1-9701-9ea7e770cea3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 24265 microversion: 2.20 time: 0.187483 Oct 28 12:31:52.502493 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 107/188] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:31:52 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 24265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:31:53.334670 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-b5162aee-98f7-4aaa-843d-ba39bcd7d529 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:53.336732 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-c17b9a8e-2886-4585-8805-33af8fdb47a2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:53.339153 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-b5162aee-98f7-4aaa-843d-ba39bcd7d529 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:53.340393 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-c17b9a8e-2886-4585-8805-33af8fdb47a2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:53.368896 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b5162aee-98f7-4aaa-843d-ba39bcd7d529 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:53.370063 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c17b9a8e-2886-4585-8805-33af8fdb47a2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:53.371283 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c17b9a8e-2886-4585-8805-33af8fdb47a2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:53.372145 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b5162aee-98f7-4aaa-843d-ba39bcd7d529 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:53.375619 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b5162aee-98f7-4aaa-843d-ba39bcd7d529 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:53.376950 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c17b9a8e-2886-4585-8805-33af8fdb47a2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:53.377551 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b5162aee-98f7-4aaa-843d-ba39bcd7d529 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:53.379103 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c17b9a8e-2886-4585-8805-33af8fdb47a2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:53.521009 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-c17b9a8e-2886-4585-8805-33af8fdb47a2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 200 len: 22888 microversion: 2.1 time: 0.196887 Oct 28 12:31:53.525936 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 108/189] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:31:53 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 22888 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:31:53.532781 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-6b20196c-a323-47e3-a37b-ba0e5e202f0c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:53.533801 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-6b20196c-a323-47e3-a37b-ba0e5e202f0c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:53.549795 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6b20196c-a323-47e3-a37b-ba0e5e202f0c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:53.550246 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6b20196c-a323-47e3-a37b-ba0e5e202f0c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:53.551031 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6b20196c-a323-47e3-a37b-ba0e5e202f0c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:53.551460 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6b20196c-a323-47e3-a37b-ba0e5e202f0c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:53.669620 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-6b20196c-a323-47e3-a37b-ba0e5e202f0c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 25761 microversion: 2.20 time: 0.141659 Oct 28 12:31:53.673822 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 109/190] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:31:53 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 25761 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:31:53.884113 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-b5162aee-98f7-4aaa-843d-ba39bcd7d529 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:53.892843 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-b5162aee-98f7-4aaa-843d-ba39bcd7d529 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1520 microversion: 2.1 time: 0.569969 Oct 28 12:31:53.907155 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 82/191] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:53 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1520 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:54.533852 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-5a9361ac-ec66-4853-920a-89e65a7f13ba tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:54.534850 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-5a9361ac-ec66-4853-920a-89e65a7f13ba tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:54.547784 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5a9361ac-ec66-4853-920a-89e65a7f13ba tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:54.548232 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5a9361ac-ec66-4853-920a-89e65a7f13ba tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:54.549051 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5a9361ac-ec66-4853-920a-89e65a7f13ba tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:54.549488 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5a9361ac-ec66-4853-920a-89e65a7f13ba tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:54.674535 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-5a9361ac-ec66-4853-920a-89e65a7f13ba tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 200 len: 24321 microversion: 2.1 time: 0.144809 Oct 28 12:31:54.675564 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 110/192] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:31:54 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 24321 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:31:54.685379 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-27956903-3ea8-4ad6-bd7a-2d54196dfeb4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:54.686837 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-27956903-3ea8-4ad6-bd7a-2d54196dfeb4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:54.696373 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-27956903-3ea8-4ad6-bd7a-2d54196dfeb4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:54.696849 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-27956903-3ea8-4ad6-bd7a-2d54196dfeb4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:54.697682 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-27956903-3ea8-4ad6-bd7a-2d54196dfeb4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:54.698037 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-27956903-3ea8-4ad6-bd7a-2d54196dfeb4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:54.824748 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-27956903-3ea8-4ad6-bd7a-2d54196dfeb4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 26798 microversion: 2.20 time: 0.143115 Oct 28 12:31:54.826354 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 83/193] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:31:54 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 26798 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:31:54.916195 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-7dca27d1-6a20-4d64-b09f-8068d0d5026e tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:54.916958 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-7dca27d1-6a20-4d64-b09f-8068d0d5026e tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:54.930483 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7dca27d1-6a20-4d64-b09f-8068d0d5026e tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:54.930925 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7dca27d1-6a20-4d64-b09f-8068d0d5026e tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:54.934052 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7dca27d1-6a20-4d64-b09f-8068d0d5026e tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:54.935084 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7dca27d1-6a20-4d64-b09f-8068d0d5026e tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:55.460185 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-7dca27d1-6a20-4d64-b09f-8068d0d5026e tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:55.471400 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-7dca27d1-6a20-4d64-b09f-8068d0d5026e tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1520 microversion: 2.1 time: 0.559611 Oct 28 12:31:55.485020 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 111/194] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:54 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1520 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:55.698042 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-74f06584-6fcd-4773-bb6c-00db5af943bd tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:55.699250 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-74f06584-6fcd-4773-bb6c-00db5af943bd tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:55.713086 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-74f06584-6fcd-4773-bb6c-00db5af943bd tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:55.713528 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-74f06584-6fcd-4773-bb6c-00db5af943bd tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:55.714308 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-74f06584-6fcd-4773-bb6c-00db5af943bd tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:55.714748 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-74f06584-6fcd-4773-bb6c-00db5af943bd tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:55.837795 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-d74c11ac-3443-4091-9ff4-1ebf6b00e02b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:55.838837 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-d74c11ac-3443-4091-9ff4-1ebf6b00e02b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:55.852050 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-74f06584-6fcd-4773-bb6c-00db5af943bd tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 200 len: 25707 microversion: 2.1 time: 0.169343 Oct 28 12:31:55.852448 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d74c11ac-3443-4091-9ff4-1ebf6b00e02b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:55.852699 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 84/195] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:31:55 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 25707 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:31:55.857172 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d74c11ac-3443-4091-9ff4-1ebf6b00e02b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:55.858970 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d74c11ac-3443-4091-9ff4-1ebf6b00e02b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:55.859408 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d74c11ac-3443-4091-9ff4-1ebf6b00e02b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:55.988281 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-d74c11ac-3443-4091-9ff4-1ebf6b00e02b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 27560 microversion: 2.20 time: 0.154720 Oct 28 12:31:55.993830 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 112/196] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:31:55 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 27560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:31:56.494460 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-42ca2ab1-3d17-4970-92aa-d98901a291d3 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:56.495175 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-42ca2ab1-3d17-4970-92aa-d98901a291d3 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:56.508759 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-42ca2ab1-3d17-4970-92aa-d98901a291d3 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:56.508959 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-42ca2ab1-3d17-4970-92aa-d98901a291d3 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:56.515753 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-42ca2ab1-3d17-4970-92aa-d98901a291d3 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:56.516465 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-42ca2ab1-3d17-4970-92aa-d98901a291d3 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:56.766489 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-42ca2ab1-3d17-4970-92aa-d98901a291d3 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:56.782413 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-42ca2ab1-3d17-4970-92aa-d98901a291d3 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1520 microversion: 2.1 time: 0.294023 Oct 28 12:31:56.783594 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 85/197] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:56 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1520 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:56.873086 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-b52b0b1d-e592-45c0-8e5b-d06c589ec379 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:56.874911 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-b52b0b1d-e592-45c0-8e5b-d06c589ec379 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:56.912387 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b52b0b1d-e592-45c0-8e5b-d06c589ec379 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:56.912950 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b52b0b1d-e592-45c0-8e5b-d06c589ec379 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:56.915351 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b52b0b1d-e592-45c0-8e5b-d06c589ec379 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:56.915792 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b52b0b1d-e592-45c0-8e5b-d06c589ec379 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:57.001758 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-d8600818-905d-4e76-8b41-011c0d48ed81 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:57.003011 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-d8600818-905d-4e76-8b41-011c0d48ed81 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:57.020427 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d8600818-905d-4e76-8b41-011c0d48ed81 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:57.021786 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d8600818-905d-4e76-8b41-011c0d48ed81 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:57.023501 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d8600818-905d-4e76-8b41-011c0d48ed81 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:57.024240 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d8600818-905d-4e76-8b41-011c0d48ed81 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:58.906843 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-d8600818-905d-4e76-8b41-011c0d48ed81 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 27915 microversion: 2.20 time: 1.909873 Oct 28 12:31:58.907518 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 86/198] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:31:56 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 27915 bytes in 1911 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:31:58.914201 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-081b574e-9a47-492f-81fc-02a8184be02e tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:31:58.914983 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-081b574e-9a47-492f-81fc-02a8184be02e tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:58.922178 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-081b574e-9a47-492f-81fc-02a8184be02e tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:58.922618 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-081b574e-9a47-492f-81fc-02a8184be02e tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:58.923393 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-081b574e-9a47-492f-81fc-02a8184be02e tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:58.923840 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-081b574e-9a47-492f-81fc-02a8184be02e tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:58.930539 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-b52b0b1d-e592-45c0-8e5b-d06c589ec379 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 200 len: 27552 microversion: 2.1 time: 2.068951 Oct 28 12:31:58.931411 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 113/199] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:31:56 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 27552 bytes in 2072 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:31:59.067027 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-081b574e-9a47-492f-81fc-02a8184be02e tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:31:59.077925 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-081b574e-9a47-492f-81fc-02a8184be02e tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1520 microversion: 2.1 time: 0.169263 Oct 28 12:31:59.078992 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 87/200] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:31:58 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:59.126414 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-502687a1-c817-4e8b-8997-08d9f26173a3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Action: 'create', calling method: .version_select at 0x7f4a7968e820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1357312688"}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:59.158571 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.quota [None req-502687a1-c817-4e8b-8997-08d9f26173a3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Getting quotas for project 70a330da99234af6b3a80df822d5067f. Resources: {'key_pairs'} {{(pid=115877) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:31:59.162547 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.quota [None req-502687a1-c817-4e8b-8997-08d9f26173a3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Getting quotas for user 4303ee654346434cb52fa498176297b1 and project 70a330da99234af6b3a80df822d5067f. Resources: {'key_pairs'} {{(pid=115877) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:31:59.711616 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.quota [None req-502687a1-c817-4e8b-8997-08d9f26173a3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Getting quotas for project 70a330da99234af6b3a80df822d5067f. Resources: {'key_pairs'} {{(pid=115877) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:31:59.716207 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.quota [None req-502687a1-c817-4e8b-8997-08d9f26173a3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Getting quotas for user 4303ee654346434cb52fa498176297b1 and project 70a330da99234af6b3a80df822d5067f. Resources: {'key_pairs'} {{(pid=115877) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:31:59.729980 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-502687a1-c817-4e8b-8997-08d9f26173a3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.796993 Oct 28 12:31:59.730973 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 114/201] 10.222.0.62 () {60 vars in 1157 bytes} [Thu Oct 28 12:31:58 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:31:59.936107 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-00fff225-205c-4f87-b1e4-45592998f677 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:59.938276 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-00fff225-205c-4f87-b1e4-45592998f677 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:59.943390 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-0e0196f7-6369-41a4-a3dd-332b3093f22f tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:31:59.944472 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-0e0196f7-6369-41a4-a3dd-332b3093f22f tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:31:59.946811 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-00fff225-205c-4f87-b1e4-45592998f677 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:59.947485 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-00fff225-205c-4f87-b1e4-45592998f677 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:59.948457 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-00fff225-205c-4f87-b1e4-45592998f677 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:59.949298 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-00fff225-205c-4f87-b1e4-45592998f677 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:59.957808 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0e0196f7-6369-41a4-a3dd-332b3093f22f tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:59.958246 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0e0196f7-6369-41a4-a3dd-332b3093f22f tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:31:59.959010 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0e0196f7-6369-41a4-a3dd-332b3093f22f tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:31:59.959427 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0e0196f7-6369-41a4-a3dd-332b3093f22f tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:02.725471 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-00fff225-205c-4f87-b1e4-45592998f677 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 28277 microversion: 2.20 time: 2.810405 Oct 28 12:32:02.725948 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 88/202] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:31:59 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 28277 bytes in 2812 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:32:02.731210 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-c31368dd-51ff-4958-a1a7-c7649fd8ccb6 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:02.731911 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-c31368dd-51ff-4958-a1a7-c7649fd8ccb6 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:02.739006 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c31368dd-51ff-4958-a1a7-c7649fd8ccb6 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:02.739445 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c31368dd-51ff-4958-a1a7-c7649fd8ccb6 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:02.740258 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c31368dd-51ff-4958-a1a7-c7649fd8ccb6 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:02.740681 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c31368dd-51ff-4958-a1a7-c7649fd8ccb6 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:02.747606 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-0e0196f7-6369-41a4-a3dd-332b3093f22f tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 200 len: 27927 microversion: 2.1 time: 2.808292 Oct 28 12:32:02.749346 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 115/203] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:31:59 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 27927 bytes in 2811 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:32:02.874440 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-c31368dd-51ff-4958-a1a7-c7649fd8ccb6 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:02.881804 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-c31368dd-51ff-4958-a1a7-c7649fd8ccb6 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1520 microversion: 2.1 time: 0.154602 Oct 28 12:32:02.882394 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 89/204] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:02 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:03.738704 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-64d8322c-2aa4-4a55-ab0d-e417f9ddd218 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:03.739694 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-64d8322c-2aa4-4a55-ab0d-e417f9ddd218 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:03.747046 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-64d8322c-2aa4-4a55-ab0d-e417f9ddd218 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:03.747550 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-64d8322c-2aa4-4a55-ab0d-e417f9ddd218 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:03.748316 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-64d8322c-2aa4-4a55-ab0d-e417f9ddd218 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:03.748897 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-64d8322c-2aa4-4a55-ab0d-e417f9ddd218 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:03.759351 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-81cf5a93-611e-4538-82ca-10f0df3b3fef tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:03.760263 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-81cf5a93-611e-4538-82ca-10f0df3b3fef tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:03.767254 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-81cf5a93-611e-4538-82ca-10f0df3b3fef tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:03.767698 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-81cf5a93-611e-4538-82ca-10f0df3b3fef tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:03.768469 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-81cf5a93-611e-4538-82ca-10f0df3b3fef tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:03.769088 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-81cf5a93-611e-4538-82ca-10f0df3b3fef tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:06.277390 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-64d8322c-2aa4-4a55-ab0d-e417f9ddd218 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 28277 microversion: 2.20 time: 2.543181 Oct 28 12:32:06.279634 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 116/205] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:32:03 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 28277 bytes in 2546 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:32:06.287009 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-ee3d4b16-6a75-45aa-9484-4e9c259b47b9 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:06.288324 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-ee3d4b16-6a75-45aa-9484-4e9c259b47b9 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:06.295942 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ee3d4b16-6a75-45aa-9484-4e9c259b47b9 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:06.296674 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ee3d4b16-6a75-45aa-9484-4e9c259b47b9 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:06.297500 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ee3d4b16-6a75-45aa-9484-4e9c259b47b9 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:06.297929 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ee3d4b16-6a75-45aa-9484-4e9c259b47b9 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:06.311611 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-81cf5a93-611e-4538-82ca-10f0df3b3fef tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 200 len: 28162 microversion: 2.1 time: 2.555543 Oct 28 12:32:06.312238 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 90/206] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:32:03 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 28162 bytes in 2557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:32:06.425796 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-ee3d4b16-6a75-45aa-9484-4e9c259b47b9 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:06.435056 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-ee3d4b16-6a75-45aa-9484-4e9c259b47b9 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1520 microversion: 2.1 time: 0.154899 Oct 28 12:32:06.435954 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 117/207] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:06 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:07.291427 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-c12b9f2d-7e82-4151-bbb7-568749e419cc tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:07.292303 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-c12b9f2d-7e82-4151-bbb7-568749e419cc tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:07.299996 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c12b9f2d-7e82-4151-bbb7-568749e419cc tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:07.300444 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c12b9f2d-7e82-4151-bbb7-568749e419cc tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:07.301248 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c12b9f2d-7e82-4151-bbb7-568749e419cc tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:07.301675 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c12b9f2d-7e82-4151-bbb7-568749e419cc tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:07.326124 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-2ce8bd6f-8072-4da7-b97f-cf5bcbd9ae42 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:07.327252 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-2ce8bd6f-8072-4da7-b97f-cf5bcbd9ae42 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:07.339778 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2ce8bd6f-8072-4da7-b97f-cf5bcbd9ae42 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:07.340218 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2ce8bd6f-8072-4da7-b97f-cf5bcbd9ae42 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:07.341036 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2ce8bd6f-8072-4da7-b97f-cf5bcbd9ae42 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:07.341488 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2ce8bd6f-8072-4da7-b97f-cf5bcbd9ae42 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:07.391413 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-c12b9f2d-7e82-4151-bbb7-568749e419cc tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 28277 microversion: 2.20 time: 0.104003 Oct 28 12:32:07.392061 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 91/208] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:32:07 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 28277 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:32:07.456030 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-dc5d73b2-654b-43a7-b815-2ff4d1054e16 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:07.457030 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-dc5d73b2-654b-43a7-b815-2ff4d1054e16 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:07.466379 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-dc5d73b2-654b-43a7-b815-2ff4d1054e16 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:07.467108 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-dc5d73b2-654b-43a7-b815-2ff4d1054e16 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:07.468131 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-dc5d73b2-654b-43a7-b815-2ff4d1054e16 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:07.468556 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-dc5d73b2-654b-43a7-b815-2ff4d1054e16 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:07.605960 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-dc5d73b2-654b-43a7-b815-2ff4d1054e16 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:07.614758 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-dc5d73b2-654b-43a7-b815-2ff4d1054e16 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1520 microversion: 2.1 time: 0.165418 Oct 28 12:32:07.615335 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 92/209] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:07 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:07.631315 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-2ce8bd6f-8072-4da7-b97f-cf5bcbd9ae42 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 200 len: 28162 microversion: 2.1 time: 0.310720 Oct 28 12:32:07.632099 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 118/210] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:32:07 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 28162 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:32:08.404465 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-ff92c8bc-854d-44bb-8f56-9462e6bfc3c9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:08.405524 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-ff92c8bc-854d-44bb-8f56-9462e6bfc3c9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:08.412021 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ff92c8bc-854d-44bb-8f56-9462e6bfc3c9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:08.412466 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ff92c8bc-854d-44bb-8f56-9462e6bfc3c9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:08.413268 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ff92c8bc-854d-44bb-8f56-9462e6bfc3c9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:08.413695 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ff92c8bc-854d-44bb-8f56-9462e6bfc3c9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:08.520455 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-ff92c8bc-854d-44bb-8f56-9462e6bfc3c9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 28481 microversion: 2.20 time: 0.120036 Oct 28 12:32:08.521121 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 93/211] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:32:08 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 28481 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:32:08.634148 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-4caf9032-8e28-4166-a013-175caaafe47f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:08.634810 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-4caf9032-8e28-4166-a013-175caaafe47f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:08.643780 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-5da5c4d7-cc3f-4825-b7e1-4e000e90926a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:08.645171 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4caf9032-8e28-4166-a013-175caaafe47f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:08.645382 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-5da5c4d7-cc3f-4825-b7e1-4e000e90926a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:08.645617 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4caf9032-8e28-4166-a013-175caaafe47f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:08.646391 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4caf9032-8e28-4166-a013-175caaafe47f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:08.646816 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4caf9032-8e28-4166-a013-175caaafe47f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:08.654132 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5da5c4d7-cc3f-4825-b7e1-4e000e90926a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:08.654924 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5da5c4d7-cc3f-4825-b7e1-4e000e90926a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:08.655796 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5da5c4d7-cc3f-4825-b7e1-4e000e90926a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:08.656652 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5da5c4d7-cc3f-4825-b7e1-4e000e90926a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:08.739544 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-5da5c4d7-cc3f-4825-b7e1-4e000e90926a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 200 len: 28162 microversion: 2.1 time: 0.099677 Oct 28 12:32:08.740244 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 94/212] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:32:08 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 28162 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:32:08.785696 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-4caf9032-8e28-4166-a013-175caaafe47f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:08.796059 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-4caf9032-8e28-4166-a013-175caaafe47f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1520 microversion: 2.1 time: 0.167564 Oct 28 12:32:08.800879 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 119/213] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:08 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:09.533978 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-6317fd21-0d75-4f8c-bf13-1f26f829bcd5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:09.534986 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-6317fd21-0d75-4f8c-bf13-1f26f829bcd5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:09.547852 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6317fd21-0d75-4f8c-bf13-1f26f829bcd5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:09.556687 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6317fd21-0d75-4f8c-bf13-1f26f829bcd5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:09.558404 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6317fd21-0d75-4f8c-bf13-1f26f829bcd5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:09.559692 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6317fd21-0d75-4f8c-bf13-1f26f829bcd5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:09.668152 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-6317fd21-0d75-4f8c-bf13-1f26f829bcd5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 28560 microversion: 2.20 time: 0.137857 Oct 28 12:32:09.669692 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 95/214] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:32:09 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 28560 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:32:09.752855 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-e25e385b-fd86-49b5-b3b4-c9afefcef5c0 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:09.753891 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-e25e385b-fd86-49b5-b3b4-c9afefcef5c0 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:09.760833 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e25e385b-fd86-49b5-b3b4-c9afefcef5c0 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:09.761627 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e25e385b-fd86-49b5-b3b4-c9afefcef5c0 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:09.762387 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e25e385b-fd86-49b5-b3b4-c9afefcef5c0 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:09.763568 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e25e385b-fd86-49b5-b3b4-c9afefcef5c0 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:09.814601 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-bdaa87bf-5b78-4f61-b88a-2b51f06e794c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:09.815356 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-bdaa87bf-5b78-4f61-b88a-2b51f06e794c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:09.822371 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-bdaa87bf-5b78-4f61-b88a-2b51f06e794c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:09.822773 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-bdaa87bf-5b78-4f61-b88a-2b51f06e794c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:09.823567 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-bdaa87bf-5b78-4f61-b88a-2b51f06e794c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:09.823963 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-bdaa87bf-5b78-4f61-b88a-2b51f06e794c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:09.882631 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-e25e385b-fd86-49b5-b3b4-c9afefcef5c0 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 200 len: 28450 microversion: 2.1 time: 0.134833 Oct 28 12:32:09.883787 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 120/215] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:32:09 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 28450 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:32:09.959462 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-bdaa87bf-5b78-4f61-b88a-2b51f06e794c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:09.967787 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-bdaa87bf-5b78-4f61-b88a-2b51f06e794c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1500 microversion: 2.1 time: 0.157446 Oct 28 12:32:09.970765 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 96/216] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:09 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1500 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:32:09.987980 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-192a7b97-fba2-4879-a14b-c0740b9046d8 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3775c537-ff28-48fa-b327-5bb66c389bf7"}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:09.989399 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-192a7b97-fba2-4879-a14b-c0740b9046d8 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:09.996374 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-192a7b97-fba2-4879-a14b-c0740b9046d8 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:09.996848 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-192a7b97-fba2-4879-a14b-c0740b9046d8 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:09.997843 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-192a7b97-fba2-4879-a14b-c0740b9046d8 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:09.998441 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-192a7b97-fba2-4879-a14b-c0740b9046d8 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:10.024806 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.wsgi [None req-192a7b97-fba2-4879-a14b-c0740b9046d8 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] HTTP exception thrown: Cannot 'attach_volume' instance 358e5707-b5af-4ff5-9308-489054458c20 while it is in vm_state rescued Oct 28 12:32:10.025401 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-192a7b97-fba2-4879-a14b-c0740b9046d8 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Returning 409 to user: Cannot 'attach_volume' instance 358e5707-b5af-4ff5-9308-489054458c20 while it is in vm_state rescued {{(pid=115877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:32:10.026284 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-192a7b97-fba2-4879-a14b-c0740b9046d8 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "POST /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043110 Oct 28 12:32:10.026934 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 121/217] 10.222.0.62 () {60 vars in 1322 bytes} [Thu Oct 28 12:32:09 2021] POST /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 12:32:10.038053 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-ebc4a1f1-0859-40fe-9f13-67545f9f5ff9 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:10.038759 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-ebc4a1f1-0859-40fe-9f13-67545f9f5ff9 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:10.045788 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ebc4a1f1-0859-40fe-9f13-67545f9f5ff9 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:10.046230 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ebc4a1f1-0859-40fe-9f13-67545f9f5ff9 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:10.047028 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ebc4a1f1-0859-40fe-9f13-67545f9f5ff9 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:10.047459 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ebc4a1f1-0859-40fe-9f13-67545f9f5ff9 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:10.134791 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-ebc4a1f1-0859-40fe-9f13-67545f9f5ff9 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "POST /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20/action" status: 202 len: 0 microversion: 2.1 time: 0.100400 Oct 28 12:32:10.148950 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 97/218] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:32:10 2021] POST /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:32:10.154027 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-16c8dfdb-bdf2-42b9-816e-632cd5a86aaa tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:10.156079 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-16c8dfdb-bdf2-42b9-816e-632cd5a86aaa tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:10.170961 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-16c8dfdb-bdf2-42b9-816e-632cd5a86aaa tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:10.171439 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-16c8dfdb-bdf2-42b9-816e-632cd5a86aaa tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:10.172404 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-16c8dfdb-bdf2-42b9-816e-632cd5a86aaa tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:10.172869 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-16c8dfdb-bdf2-42b9-816e-632cd5a86aaa tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:10.536833 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-16c8dfdb-bdf2-42b9-816e-632cd5a86aaa tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:10.556697 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-16c8dfdb-bdf2-42b9-816e-632cd5a86aaa tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1508 microversion: 2.1 time: 0.413417 Oct 28 12:32:10.557894 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 122/219] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:10 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1508 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:10.685923 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-14115f5a-613e-4a9f-b0b4-13b4f6389654 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:10.687617 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-14115f5a-613e-4a9f-b0b4-13b4f6389654 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:10.694184 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-14115f5a-613e-4a9f-b0b4-13b4f6389654 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:10.703866 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-14115f5a-613e-4a9f-b0b4-13b4f6389654 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:10.704706 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-14115f5a-613e-4a9f-b0b4-13b4f6389654 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:10.710871 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-14115f5a-613e-4a9f-b0b4-13b4f6389654 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:10.895686 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-13acfa91-b314-4ed7-9a56-b16c3f9e6f9e tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:10.896690 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-13acfa91-b314-4ed7-9a56-b16c3f9e6f9e tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:10.904152 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-13acfa91-b314-4ed7-9a56-b16c3f9e6f9e tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:10.906053 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-13acfa91-b314-4ed7-9a56-b16c3f9e6f9e tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:10.909477 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-13acfa91-b314-4ed7-9a56-b16c3f9e6f9e tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:10.912504 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-13acfa91-b314-4ed7-9a56-b16c3f9e6f9e tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:11.049195 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-14115f5a-613e-4a9f-b0b4-13b4f6389654 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 28728 microversion: 2.20 time: 0.368964 Oct 28 12:32:11.049782 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 98/220] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:32:10 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 28728 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:32:11.077431 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-13acfa91-b314-4ed7-9a56-b16c3f9e6f9e tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 200 len: 28452 microversion: 2.1 time: 0.185740 Oct 28 12:32:11.078088 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 123/221] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:32:10 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 28452 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:32:11.578385 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-a59aac43-6873-4935-a38f-4e05b59f2e95 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:11.579156 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-a59aac43-6873-4935-a38f-4e05b59f2e95 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:11.588820 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a59aac43-6873-4935-a38f-4e05b59f2e95 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:11.589290 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a59aac43-6873-4935-a38f-4e05b59f2e95 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:11.590887 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a59aac43-6873-4935-a38f-4e05b59f2e95 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:11.591441 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a59aac43-6873-4935-a38f-4e05b59f2e95 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:11.730072 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-a59aac43-6873-4935-a38f-4e05b59f2e95 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:11.738625 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-a59aac43-6873-4935-a38f-4e05b59f2e95 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1508 microversion: 2.1 time: 0.166493 Oct 28 12:32:11.739222 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 99/222] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:11 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:11.853275 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-a82d0053-10c3-49fa-b633-906f63b13271 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-654112181", "imageRef": "575f28c8-0af2-4973-b3d9-a249e2400c6e", "flavorRef": "452"}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:12.061883 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-15defc45-00e5-4237-8a8b-46d6e5c70d5d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:12.062808 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-15defc45-00e5-4237-8a8b-46d6e5c70d5d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:12.069199 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-15defc45-00e5-4237-8a8b-46d6e5c70d5d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:12.069892 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-15defc45-00e5-4237-8a8b-46d6e5c70d5d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:12.070883 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-15defc45-00e5-4237-8a8b-46d6e5c70d5d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:12.071317 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-15defc45-00e5-4237-8a8b-46d6e5c70d5d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:12.160858 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-15defc45-00e5-4237-8a8b-46d6e5c70d5d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 28728 microversion: 2.20 time: 0.103585 Oct 28 12:32:12.161692 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 100/223] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:32:12 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 28728 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:32:12.167923 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-9a2607f2-7e99-43a7-95a6-1bdc25c69f3d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:12.169280 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-9a2607f2-7e99-43a7-95a6-1bdc25c69f3d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:12.176701 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9a2607f2-7e99-43a7-95a6-1bdc25c69f3d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:12.177322 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9a2607f2-7e99-43a7-95a6-1bdc25c69f3d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:12.178151 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9a2607f2-7e99-43a7-95a6-1bdc25c69f3d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:12.178662 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9a2607f2-7e99-43a7-95a6-1bdc25c69f3d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:12.298608 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-9a2607f2-7e99-43a7-95a6-1bdc25c69f3d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 200 len: 28616 microversion: 2.1 time: 0.135197 Oct 28 12:32:12.300269 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 101/224] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:32:12 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 28616 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:32:12.757757 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-e5a24a22-7161-4c3c-a1ea-81fd34cf8b62 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:12.758550 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-e5a24a22-7161-4c3c-a1ea-81fd34cf8b62 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:12.766036 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e5a24a22-7161-4c3c-a1ea-81fd34cf8b62 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:12.766482 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e5a24a22-7161-4c3c-a1ea-81fd34cf8b62 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:12.767372 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e5a24a22-7161-4c3c-a1ea-81fd34cf8b62 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:12.767809 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e5a24a22-7161-4c3c-a1ea-81fd34cf8b62 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:12.899390 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-e5a24a22-7161-4c3c-a1ea-81fd34cf8b62 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:12.908674 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-e5a24a22-7161-4c3c-a1ea-81fd34cf8b62 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1508 microversion: 2.1 time: 0.155998 Oct 28 12:32:12.909271 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 102/225] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:12 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:13.173821 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-66f936e7-eef9-4fc6-a3d2-141f52d5b45a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:13.175140 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-66f936e7-eef9-4fc6-a3d2-141f52d5b45a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:13.186058 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-66f936e7-eef9-4fc6-a3d2-141f52d5b45a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:13.186704 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-66f936e7-eef9-4fc6-a3d2-141f52d5b45a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:13.187606 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-66f936e7-eef9-4fc6-a3d2-141f52d5b45a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:13.188041 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-66f936e7-eef9-4fc6-a3d2-141f52d5b45a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:13.288992 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-66f936e7-eef9-4fc6-a3d2-141f52d5b45a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 28728 microversion: 2.20 time: 0.119584 Oct 28 12:32:13.290714 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 103/226] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:32:13 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 28728 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:32:13.310712 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-390da19f-2759-4942-8bfe-bc0c74d5618d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:13.312199 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-390da19f-2759-4942-8bfe-bc0c74d5618d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:13.319396 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-390da19f-2759-4942-8bfe-bc0c74d5618d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:13.319846 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-390da19f-2759-4942-8bfe-bc0c74d5618d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:13.320619 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-390da19f-2759-4942-8bfe-bc0c74d5618d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:13.321089 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-390da19f-2759-4942-8bfe-bc0c74d5618d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:13.395141 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-390da19f-2759-4942-8bfe-bc0c74d5618d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 200 len: 28616 microversion: 2.1 time: 0.088712 Oct 28 12:32:13.395894 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 104/227] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:32:13 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 28616 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:32:13.934902 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-62a20c03-ebb4-45b0-beea-ea983db81094 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:13.935680 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-62a20c03-ebb4-45b0-beea-ea983db81094 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:13.946620 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-62a20c03-ebb4-45b0-beea-ea983db81094 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:13.947971 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-62a20c03-ebb4-45b0-beea-ea983db81094 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:13.949877 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-62a20c03-ebb4-45b0-beea-ea983db81094 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:13.949877 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-62a20c03-ebb4-45b0-beea-ea983db81094 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:14.114740 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-62a20c03-ebb4-45b0-beea-ea983db81094 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:14.125304 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-62a20c03-ebb4-45b0-beea-ea983db81094 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1514 microversion: 2.1 time: 0.201988 Oct 28 12:32:14.126321 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 105/228] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:13 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1514 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:14.303326 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-8345db92-5ddf-4de1-8839-e8b403116193 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:14.304303 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-8345db92-5ddf-4de1-8839-e8b403116193 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:14.319923 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8345db92-5ddf-4de1-8839-e8b403116193 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:14.320437 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8345db92-5ddf-4de1-8839-e8b403116193 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:14.321803 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8345db92-5ddf-4de1-8839-e8b403116193 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:14.322376 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8345db92-5ddf-4de1-8839-e8b403116193 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:14.414745 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-8345db92-5ddf-4de1-8839-e8b403116193 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 28728 microversion: 2.20 time: 0.116300 Oct 28 12:32:14.418021 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 106/229] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:32:14 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 28728 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:32:14.425929 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-54189a6f-db01-45ca-9994-19b41665a927 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:14.427130 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-54189a6f-db01-45ca-9994-19b41665a927 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:14.439933 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-54189a6f-db01-45ca-9994-19b41665a927 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:14.440378 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-54189a6f-db01-45ca-9994-19b41665a927 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:14.441492 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-54189a6f-db01-45ca-9994-19b41665a927 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:14.442195 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-54189a6f-db01-45ca-9994-19b41665a927 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:14.527431 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-54189a6f-db01-45ca-9994-19b41665a927 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 200 len: 28616 microversion: 2.1 time: 0.107882 Oct 28 12:32:14.528359 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 107/230] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:32:14 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 28616 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:32:15.432164 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-b17250ab-ad88-473f-9a04-7659eb824c74 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:15.433254 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-b17250ab-ad88-473f-9a04-7659eb824c74 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:15.449334 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b17250ab-ad88-473f-9a04-7659eb824c74 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:15.449774 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b17250ab-ad88-473f-9a04-7659eb824c74 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:15.450980 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b17250ab-ad88-473f-9a04-7659eb824c74 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:15.451609 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b17250ab-ad88-473f-9a04-7659eb824c74 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:15.549310 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-b17250ab-ad88-473f-9a04-7659eb824c74 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 28728 microversion: 2.20 time: 0.124971 Oct 28 12:32:15.553283 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 108/231] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:32:15 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 28728 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:32:15.557647 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-87eae69f-dd29-4e1a-8d1f-48acc344864a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:15.558431 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-87eae69f-dd29-4e1a-8d1f-48acc344864a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:15.566006 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-87eae69f-dd29-4e1a-8d1f-48acc344864a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:15.566437 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-87eae69f-dd29-4e1a-8d1f-48acc344864a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:15.567213 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-87eae69f-dd29-4e1a-8d1f-48acc344864a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:15.567718 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-87eae69f-dd29-4e1a-8d1f-48acc344864a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:15.733402 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-87eae69f-dd29-4e1a-8d1f-48acc344864a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:15.741528 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-87eae69f-dd29-4e1a-8d1f-48acc344864a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1514 microversion: 2.1 time: 0.189957 Oct 28 12:32:15.742294 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 109/232] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:15 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1514 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:15.747073 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-ff928d88-4714-4e27-843c-cd5e370d2123 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:15.748020 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-ff928d88-4714-4e27-843c-cd5e370d2123 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:15.754336 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ff928d88-4714-4e27-843c-cd5e370d2123 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:15.754725 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ff928d88-4714-4e27-843c-cd5e370d2123 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:15.755670 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ff928d88-4714-4e27-843c-cd5e370d2123 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:15.756017 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ff928d88-4714-4e27-843c-cd5e370d2123 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:15.824912 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-ff928d88-4714-4e27-843c-cd5e370d2123 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 200 len: 28616 microversion: 2.1 time: 0.081169 Oct 28 12:32:15.825623 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 110/233] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:32:15 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 28616 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:32:15.831433 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-7b47bd2f-d13d-47b7-b833-1b8a523c2c6a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a805c7ef-4b4b-431c-835c-b882c44767b6"}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:15.832884 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-7b47bd2f-d13d-47b7-b833-1b8a523c2c6a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:15.840514 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7b47bd2f-d13d-47b7-b833-1b8a523c2c6a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:15.841000 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7b47bd2f-d13d-47b7-b833-1b8a523c2c6a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:15.842053 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7b47bd2f-d13d-47b7-b833-1b8a523c2c6a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:15.842488 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7b47bd2f-d13d-47b7-b833-1b8a523c2c6a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:16.135354 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-7b47bd2f-d13d-47b7-b833-1b8a523c2c6a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "POST /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307573 Oct 28 12:32:16.135840 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 111/234] 10.222.0.62 () {60 vars in 1322 bytes} [Thu Oct 28 12:32:15 2021] POST /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:32:16.562032 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-b5949507-242f-473a-8f5d-00a20ce3eaa1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:16.563075 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-b5949507-242f-473a-8f5d-00a20ce3eaa1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:16.569450 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b5949507-242f-473a-8f5d-00a20ce3eaa1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:16.570181 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b5949507-242f-473a-8f5d-00a20ce3eaa1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:16.570894 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b5949507-242f-473a-8f5d-00a20ce3eaa1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:16.571601 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b5949507-242f-473a-8f5d-00a20ce3eaa1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:16.656096 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-b5949507-242f-473a-8f5d-00a20ce3eaa1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 28847 microversion: 2.20 time: 0.098994 Oct 28 12:32:16.657695 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 112/235] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:32:16 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 28847 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:32:16.837211 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-4e430ec3-840b-4077-aa2d-05136278f40c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:16.838222 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-4e430ec3-840b-4077-aa2d-05136278f40c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:16.845648 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4e430ec3-840b-4077-aa2d-05136278f40c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:16.846660 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4e430ec3-840b-4077-aa2d-05136278f40c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:16.847718 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4e430ec3-840b-4077-aa2d-05136278f40c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:16.848373 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4e430ec3-840b-4077-aa2d-05136278f40c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:16.944356 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-4e430ec3-840b-4077-aa2d-05136278f40c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 200 len: 28616 microversion: 2.1 time: 0.110968 Oct 28 12:32:16.945088 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 113/236] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:32:16 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 28616 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:32:17.671887 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-1f632804-45b0-44a3-b871-c5152de3d125 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:17.672975 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-1f632804-45b0-44a3-b871-c5152de3d125 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:17.681647 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1f632804-45b0-44a3-b871-c5152de3d125 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:17.682096 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1f632804-45b0-44a3-b871-c5152de3d125 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:17.683015 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1f632804-45b0-44a3-b871-c5152de3d125 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:17.683447 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1f632804-45b0-44a3-b871-c5152de3d125 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:17.791462 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-1f632804-45b0-44a3-b871-c5152de3d125 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 30067 microversion: 2.20 time: 0.123011 Oct 28 12:32:17.792883 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 114/237] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:32:17 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 30067 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:32:17.957206 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-eab1a305-d885-4652-a6eb-93174be37166 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:17.958325 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-eab1a305-d885-4652-a6eb-93174be37166 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:17.965719 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-eab1a305-d885-4652-a6eb-93174be37166 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:17.966155 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-eab1a305-d885-4652-a6eb-93174be37166 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:17.967029 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-eab1a305-d885-4652-a6eb-93174be37166 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:17.967530 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-eab1a305-d885-4652-a6eb-93174be37166 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:18.057312 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-eab1a305-d885-4652-a6eb-93174be37166 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 200 len: 29192 microversion: 2.1 time: 0.104775 Oct 28 12:32:18.058005 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 115/238] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:32:17 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 29192 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:32:18.809404 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-392d1586-1cb1-4b8b-9536-47ddaaba3bb9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:18.810377 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-392d1586-1cb1-4b8b-9536-47ddaaba3bb9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:18.817679 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-392d1586-1cb1-4b8b-9536-47ddaaba3bb9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:18.818211 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-392d1586-1cb1-4b8b-9536-47ddaaba3bb9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:18.819043 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-392d1586-1cb1-4b8b-9536-47ddaaba3bb9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:18.819498 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-392d1586-1cb1-4b8b-9536-47ddaaba3bb9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:18.913639 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-392d1586-1cb1-4b8b-9536-47ddaaba3bb9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 31398 microversion: 2.20 time: 0.108890 Oct 28 12:32:18.917818 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 116/239] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:32:18 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 31398 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:32:19.070743 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-c16accd5-e282-484e-bbe9-8f866c7ac72a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:19.071804 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-c16accd5-e282-484e-bbe9-8f866c7ac72a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:19.078838 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c16accd5-e282-484e-bbe9-8f866c7ac72a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:19.079280 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c16accd5-e282-484e-bbe9-8f866c7ac72a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:19.080058 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c16accd5-e282-484e-bbe9-8f866c7ac72a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:19.080474 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c16accd5-e282-484e-bbe9-8f866c7ac72a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:19.184516 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-c16accd5-e282-484e-bbe9-8f866c7ac72a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 200 len: 30590 microversion: 2.1 time: 0.118056 Oct 28 12:32:19.185198 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 117/240] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:32:19 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 30590 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:32:19.190123 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-febaee14-97ef-4b51-9cf0-415b3a340260 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2114227762", "imageRef": "575f28c8-0af2-4973-b3d9-a249e2400c6e", "flavorRef": "452", "networks": [{"uuid": "5d883604-b2a9-4d93-a8bf-ec87e84b1b2c"}]}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:28.010744 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.network.neutron [None req-a82d0053-10c3-49fa-b633-906f63b13271 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] validate_networks() for None {{(pid=115877) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:32:28.015572 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.network.neutron [None req-febaee14-97ef-4b51-9cf0-415b3a340260 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] validate_networks() for [('5d883604-b2a9-4d93-a8bf-ec87e84b1b2c', None, None, None, None, None)] {{(pid=115876) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:32:28.396448 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-a82d0053-10c3-49fa-b633-906f63b13271 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Flavor limits 0:0:0 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:32:28.397195 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-a82d0053-10c3-49fa-b633-906f63b13271 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Image limits 0:0:0 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:32:28.398500 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-a82d0053-10c3-49fa-b633-906f63b13271 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Flavor pref 0:0:0 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:32:28.399228 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-a82d0053-10c3-49fa-b633-906f63b13271 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Image pref 0:0:0 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:32:28.400222 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-a82d0053-10c3-49fa-b633-906f63b13271 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:32:28.410621 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a82d0053-10c3-49fa-b633-906f63b13271 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:28.411407 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a82d0053-10c3-49fa-b633-906f63b13271 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:28.418164 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a82d0053-10c3-49fa-b633-906f63b13271 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:28.418965 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a82d0053-10c3-49fa-b633-906f63b13271 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:28.443822 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.quota [None req-a82d0053-10c3-49fa-b633-906f63b13271 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Getting quotas for project 0885f209fd8c4c39a508059798fec9c3. Resources: {'cores', 'instances', 'ram'} {{(pid=115877) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:32:28.448131 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.quota [None req-a82d0053-10c3-49fa-b633-906f63b13271 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Getting quotas for user f4c0f7f787ad4496809a5015b221cb87 and project 0885f209fd8c4c39a508059798fec9c3. Resources: {'cores', 'instances', 'ram'} {{(pid=115877) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:32:28.461542 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-a82d0053-10c3-49fa-b633-906f63b13271 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Going to run 1 instances... {{(pid=115877) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:32:28.464926 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-a82d0053-10c3-49fa-b633-906f63b13271 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] [instance: 2c2b85ef-76d8-4707-83a5-5a83394b80df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='575f28c8-0af2-4973-b3d9-a249e2400c6e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:32:28.531389 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-a82d0053-10c3-49fa-b633-906f63b13271 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 16.687996 Oct 28 12:32:28.537373 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 124/241] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Oct 28 12:32:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 16695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 12:32:28.543618 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-d12fea8d-d99f-4f1e-954a-06a83ebc727b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:28.544900 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-d12fea8d-d99f-4f1e-954a-06a83ebc727b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:28.564117 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d12fea8d-d99f-4f1e-954a-06a83ebc727b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:28.565547 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d12fea8d-d99f-4f1e-954a-06a83ebc727b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:28.566335 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d12fea8d-d99f-4f1e-954a-06a83ebc727b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:28.566754 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d12fea8d-d99f-4f1e-954a-06a83ebc727b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:28.605340 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-febaee14-97ef-4b51-9cf0-415b3a340260 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Flavor limits 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:32:28.605866 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-febaee14-97ef-4b51-9cf0-415b3a340260 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Image limits 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:32:28.606608 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-febaee14-97ef-4b51-9cf0-415b3a340260 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Flavor pref 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:32:28.607101 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-febaee14-97ef-4b51-9cf0-415b3a340260 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Image pref 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:32:28.607906 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-febaee14-97ef-4b51-9cf0-415b3a340260 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:32:28.616979 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-febaee14-97ef-4b51-9cf0-415b3a340260 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:28.617623 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-febaee14-97ef-4b51-9cf0-415b3a340260 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:28.618448 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-febaee14-97ef-4b51-9cf0-415b3a340260 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:28.618873 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-febaee14-97ef-4b51-9cf0-415b3a340260 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:28.650550 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-febaee14-97ef-4b51-9cf0-415b3a340260 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Getting quotas for project 94643fb6f71b47f79d194ad0849be625. Resources: {'cores', 'instances', 'ram'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:32:28.654947 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-febaee14-97ef-4b51-9cf0-415b3a340260 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Getting quotas for user ba3a27389ddb44f893f2975cab49ef7a and project 94643fb6f71b47f79d194ad0849be625. Resources: {'cores', 'instances', 'ram'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:32:28.672811 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-febaee14-97ef-4b51-9cf0-415b3a340260 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Going to run 1 instances... {{(pid=115876) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:32:28.675505 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-d12fea8d-d99f-4f1e-954a-06a83ebc727b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 38271 microversion: 2.20 time: 0.136592 Oct 28 12:32:28.676541 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 125/242] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:32:28 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 38271 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:32:28.678752 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-febaee14-97ef-4b51-9cf0-415b3a340260 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: e9dc74b0-0412-4f1d-ba9f-18c7b792df75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='575f28c8-0af2-4973-b3d9-a249e2400c6e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:32:28.689581 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-bfe6a0ad-c46f-4a41-86a1-7b694c939b85 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:28.690806 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-bfe6a0ad-c46f-4a41-86a1-7b694c939b85 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:28.698776 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-bfe6a0ad-c46f-4a41-86a1-7b694c939b85 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:28.699302 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-bfe6a0ad-c46f-4a41-86a1-7b694c939b85 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:28.700135 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-bfe6a0ad-c46f-4a41-86a1-7b694c939b85 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:28.700648 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-bfe6a0ad-c46f-4a41-86a1-7b694c939b85 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:28.736105 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-febaee14-97ef-4b51-9cf0-415b3a340260 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.549609 Oct 28 12:32:28.741810 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 118/243] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Oct 28 12:32:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 9551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 12:32:28.742387 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-a6447224-07c9-4d97-8efb-82e114ceb217 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:28.743630 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-a6447224-07c9-4d97-8efb-82e114ceb217 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:28.751134 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a6447224-07c9-4d97-8efb-82e114ceb217 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:28.751566 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a6447224-07c9-4d97-8efb-82e114ceb217 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:28.752528 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a6447224-07c9-4d97-8efb-82e114ceb217 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:28.753154 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a6447224-07c9-4d97-8efb-82e114ceb217 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:28.779046 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.objects.instance [None req-a6447224-07c9-4d97-8efb-82e114ceb217 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lazy-loading 'flavor' on Instance uuid 358e5707-b5af-4ff5-9308-489054458c20 {{(pid=115876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:32:28.789332 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-bfe6a0ad-c46f-4a41-86a1-7b694c939b85 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 200 len: 38104 microversion: 2.1 time: 0.111645 Oct 28 12:32:28.790261 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 126/244] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:32:28 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 38104 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:32:28.795082 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-c34eedfc-40af-427e-93e2-bf7144d481cd tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:28.795919 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-c34eedfc-40af-427e-93e2-bf7144d481cd tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] [instance: 2c2b85ef-76d8-4707-83a5-5a83394b80df] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:28.887503 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-c34eedfc-40af-427e-93e2-bf7144d481cd tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c0f7f787ad4496809a5015b221cb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0885f209fd8c4c39a508059798fec9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:28.896095 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-c34eedfc-40af-427e-93e2-bf7144d481cd tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] 10.222.0.62 "GET /compute/v2.1/servers/2c2b85ef-76d8-4707-83a5-5a83394b80df" status: 200 len: 1214 microversion: 2.1 time: 0.104633 Oct 28 12:32:28.896674 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 127/245] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:28 2021] GET /compute/v2.1/servers/2c2b85ef-76d8-4707-83a5-5a83394b80df => generated 1214 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:28.906443 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-fc00279c-52f2-47cc-94c8-80d77a6a775d tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:28.906443 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-fc00279c-52f2-47cc-94c8-80d77a6a775d tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: e9dc74b0-0412-4f1d-ba9f-18c7b792df75] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:28.975800 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-a6447224-07c9-4d97-8efb-82e114ceb217 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "POST /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20/action" status: 200 len: 32 microversion: 2.1 time: 0.237314 Oct 28 12:32:28.980644 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-fc00279c-52f2-47cc-94c8-80d77a6a775d tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a27389ddb44f893f2975cab49ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94643fb6f71b47f79d194ad0849be625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:28.989347 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-fc00279c-52f2-47cc-94c8-80d77a6a775d tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "GET /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75" status: 200 len: 1219 microversion: 2.1 time: 0.090894 Oct 28 12:32:28.990597 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 128/246] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:28 2021] GET /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:28.992493 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 119/247] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:32:28 2021] POST /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20/action => generated 32 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:32:28.996209 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-8d39af7b-eed0-4613-aaac-d5cca652b8b1 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:28.997096 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-8d39af7b-eed0-4613-aaac-d5cca652b8b1 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:29.004066 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8d39af7b-eed0-4613-aaac-d5cca652b8b1 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:29.004588 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8d39af7b-eed0-4613-aaac-d5cca652b8b1 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:29.005461 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8d39af7b-eed0-4613-aaac-d5cca652b8b1 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:29.005892 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8d39af7b-eed0-4613-aaac-d5cca652b8b1 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:29.203103 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-8d39af7b-eed0-4613-aaac-d5cca652b8b1 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:29.214148 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-8d39af7b-eed0-4613-aaac-d5cca652b8b1 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1566 microversion: 2.1 time: 0.222233 Oct 28 12:32:29.215111 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 129/248] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:28 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1566 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:29.689019 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-fcb129c6-aaa6-46cd-88ed-04e966ad63a8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:29.690082 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-fcb129c6-aaa6-46cd-88ed-04e966ad63a8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:29.698929 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fcb129c6-aaa6-46cd-88ed-04e966ad63a8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:29.699372 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fcb129c6-aaa6-46cd-88ed-04e966ad63a8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:29.700148 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fcb129c6-aaa6-46cd-88ed-04e966ad63a8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:29.700579 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fcb129c6-aaa6-46cd-88ed-04e966ad63a8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:29.787355 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-fcb129c6-aaa6-46cd-88ed-04e966ad63a8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 38271 microversion: 2.20 time: 0.102552 Oct 28 12:32:29.792139 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 120/249] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:32:29 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 38271 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:32:29.803883 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-fc4a50cc-30ed-4e11-8795-f930e494b758 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:29.805224 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-fc4a50cc-30ed-4e11-8795-f930e494b758 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:29.812925 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fc4a50cc-30ed-4e11-8795-f930e494b758 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:29.813468 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fc4a50cc-30ed-4e11-8795-f930e494b758 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:29.814533 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fc4a50cc-30ed-4e11-8795-f930e494b758 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:29.815055 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fc4a50cc-30ed-4e11-8795-f930e494b758 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:29.913973 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-ad90affc-189e-4ef3-8112-9a069fd246f9 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:29.914930 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-ad90affc-189e-4ef3-8112-9a069fd246f9 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] [instance: 2c2b85ef-76d8-4707-83a5-5a83394b80df] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:29.922991 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ad90affc-189e-4ef3-8112-9a069fd246f9 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:29.923655 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ad90affc-189e-4ef3-8112-9a069fd246f9 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:29.924967 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ad90affc-189e-4ef3-8112-9a069fd246f9 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:29.925514 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ad90affc-189e-4ef3-8112-9a069fd246f9 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:29.944183 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-fc4a50cc-30ed-4e11-8795-f930e494b758 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 200 len: 38132 microversion: 2.1 time: 0.145838 Oct 28 12:32:29.944984 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 130/250] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:32:29 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 38132 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:32:29.997960 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-ad90affc-189e-4ef3-8112-9a069fd246f9 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c0f7f787ad4496809a5015b221cb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0885f209fd8c4c39a508059798fec9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:30.006493 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-ad90affc-189e-4ef3-8112-9a069fd246f9 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] 10.222.0.62 "GET /compute/v2.1/servers/2c2b85ef-76d8-4707-83a5-5a83394b80df" status: 200 len: 1284 microversion: 2.1 time: 0.096873 Oct 28 12:32:30.007280 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 121/251] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:29 2021] GET /compute/v2.1/servers/2c2b85ef-76d8-4707-83a5-5a83394b80df => generated 1284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:32:30.016188 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-1c44ccd0-4b15-42f7-89db-d0245eb70bc3 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:30.016188 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-1c44ccd0-4b15-42f7-89db-d0245eb70bc3 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: e9dc74b0-0412-4f1d-ba9f-18c7b792df75] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:30.019135 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1c44ccd0-4b15-42f7-89db-d0245eb70bc3 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:30.019498 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1c44ccd0-4b15-42f7-89db-d0245eb70bc3 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:30.020276 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1c44ccd0-4b15-42f7-89db-d0245eb70bc3 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:30.020699 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1c44ccd0-4b15-42f7-89db-d0245eb70bc3 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:30.084584 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-1c44ccd0-4b15-42f7-89db-d0245eb70bc3 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a27389ddb44f893f2975cab49ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94643fb6f71b47f79d194ad0849be625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:30.093320 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-1c44ccd0-4b15-42f7-89db-d0245eb70bc3 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "GET /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75" status: 200 len: 1271 microversion: 2.1 time: 0.089405 Oct 28 12:32:30.094012 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 131/252] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:30 2021] GET /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75 => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:32:30.232946 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-f2bb66ee-c9c9-4285-8b26-b8b91b9912b6 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:30.234203 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-f2bb66ee-c9c9-4285-8b26-b8b91b9912b6 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:30.241693 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f2bb66ee-c9c9-4285-8b26-b8b91b9912b6 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:30.242260 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f2bb66ee-c9c9-4285-8b26-b8b91b9912b6 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:30.243128 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f2bb66ee-c9c9-4285-8b26-b8b91b9912b6 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:30.243744 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f2bb66ee-c9c9-4285-8b26-b8b91b9912b6 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:30.445820 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f2bb66ee-c9c9-4285-8b26-b8b91b9912b6 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:30.454271 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-f2bb66ee-c9c9-4285-8b26-b8b91b9912b6 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1566 microversion: 2.1 time: 0.225341 Oct 28 12:32:30.464188 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 122/253] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:30 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1566 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:30.801032 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-2f39bd35-d83d-480a-92d2-06112795b9be tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:30.802835 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-2f39bd35-d83d-480a-92d2-06112795b9be tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:30.813037 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2f39bd35-d83d-480a-92d2-06112795b9be tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:30.813996 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2f39bd35-d83d-480a-92d2-06112795b9be tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:30.815931 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2f39bd35-d83d-480a-92d2-06112795b9be tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:30.816497 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2f39bd35-d83d-480a-92d2-06112795b9be tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:30.917482 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-2f39bd35-d83d-480a-92d2-06112795b9be tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 38283 microversion: 2.20 time: 0.120563 Oct 28 12:32:30.922077 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 132/254] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:32:30 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 38283 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:32:30.965651 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-eb911105-fbd0-4e09-832b-980860dbdd84 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:30.967844 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-eb911105-fbd0-4e09-832b-980860dbdd84 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:30.977828 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-eb911105-fbd0-4e09-832b-980860dbdd84 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:30.978589 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-eb911105-fbd0-4e09-832b-980860dbdd84 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:30.979897 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-eb911105-fbd0-4e09-832b-980860dbdd84 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:30.980337 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-eb911105-fbd0-4e09-832b-980860dbdd84 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:31.025720 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-80462954-640d-456c-a638-91d658aca02b tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:31.026453 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-80462954-640d-456c-a638-91d658aca02b tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] [instance: 2c2b85ef-76d8-4707-83a5-5a83394b80df] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:31.040385 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-80462954-640d-456c-a638-91d658aca02b tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:31.041141 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-80462954-640d-456c-a638-91d658aca02b tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:31.042553 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-80462954-640d-456c-a638-91d658aca02b tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:31.043147 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-80462954-640d-456c-a638-91d658aca02b tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:31.094510 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-eb911105-fbd0-4e09-832b-980860dbdd84 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 200 len: 38132 microversion: 2.1 time: 0.140886 Oct 28 12:32:31.099753 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 123/255] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:32:30 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 38132 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:32:31.112195 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-36296ae1-8f49-48a9-9afc-9f94b8e97159 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:31.112926 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-36296ae1-8f49-48a9-9afc-9f94b8e97159 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: e9dc74b0-0412-4f1d-ba9f-18c7b792df75] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:31.119659 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-36296ae1-8f49-48a9-9afc-9f94b8e97159 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:31.120487 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-36296ae1-8f49-48a9-9afc-9f94b8e97159 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:31.121304 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-36296ae1-8f49-48a9-9afc-9f94b8e97159 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:31.121740 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-36296ae1-8f49-48a9-9afc-9f94b8e97159 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:31.547976 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-80462954-640d-456c-a638-91d658aca02b tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c0f7f787ad4496809a5015b221cb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0885f209fd8c4c39a508059798fec9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:31.556061 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-80462954-640d-456c-a638-91d658aca02b tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] 10.222.0.62 "GET /compute/v2.1/servers/2c2b85ef-76d8-4707-83a5-5a83394b80df" status: 200 len: 1314 microversion: 2.1 time: 0.535914 Oct 28 12:32:31.557551 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 133/256] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:31 2021] GET /compute/v2.1/servers/2c2b85ef-76d8-4707-83a5-5a83394b80df => generated 1314 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:31.570139 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-d7ca312c-92da-42de-b401-413b54d95272 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:31.570906 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-d7ca312c-92da-42de-b401-413b54d95272 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:31.579869 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d7ca312c-92da-42de-b401-413b54d95272 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:31.580489 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d7ca312c-92da-42de-b401-413b54d95272 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:31.581867 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d7ca312c-92da-42de-b401-413b54d95272 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:31.582875 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d7ca312c-92da-42de-b401-413b54d95272 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:31.651804 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-36296ae1-8f49-48a9-9afc-9f94b8e97159 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a27389ddb44f893f2975cab49ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94643fb6f71b47f79d194ad0849be625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:31.666542 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-36296ae1-8f49-48a9-9afc-9f94b8e97159 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "GET /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75" status: 200 len: 1319 microversion: 2.1 time: 0.558697 Oct 28 12:32:31.667154 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 124/257] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:31 2021] GET /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75 => generated 1319 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:31.681234 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-851d6842-9a69-44f0-96f9-1f1bb650d757 req-146630a8-8510-4349-9d3a-bece4a05f575 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c2b85ef-76d8-4707-83a5-5a83394b80df", "tag": "7c81d3d4-a1e4-4e95-b3ef-ec5660cf0f30"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:31.687245 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:32:31.687245 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:32:31.700543 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-851d6842-9a69-44f0-96f9-1f1bb650d757 req-146630a8-8510-4349-9d3a-bece4a05f575 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:31.701000 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-851d6842-9a69-44f0-96f9-1f1bb650d757 req-146630a8-8510-4349-9d3a-bece4a05f575 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:31.715337 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-851d6842-9a69-44f0-96f9-1f1bb650d757 req-146630a8-8510-4349-9d3a-bece4a05f575 service nova] Creating event network-changed:7c81d3d4-a1e4-4e95-b3ef-ec5660cf0f30 for instance 2c2b85ef-76d8-4707-83a5-5a83394b80df on hv-cinder-81514 Oct 28 12:32:31.721912 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-851d6842-9a69-44f0-96f9-1f1bb650d757 req-146630a8-8510-4349-9d3a-bece4a05f575 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044096 Oct 28 12:32:31.725292 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 125/258] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:32:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:32:31.835415 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-d7ca312c-92da-42de-b401-413b54d95272 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:31.844317 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-d7ca312c-92da-42de-b401-413b54d95272 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1566 microversion: 2.1 time: 0.284770 Oct 28 12:32:31.847441 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 134/259] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:31 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1566 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:31.931711 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-1b34260c-5116-4cb8-bc05-0c839e7cad5b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:31.934097 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-1b34260c-5116-4cb8-bc05-0c839e7cad5b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:31.941571 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1b34260c-5116-4cb8-bc05-0c839e7cad5b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:31.942831 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1b34260c-5116-4cb8-bc05-0c839e7cad5b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:31.942831 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1b34260c-5116-4cb8-bc05-0c839e7cad5b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:31.943288 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1b34260c-5116-4cb8-bc05-0c839e7cad5b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:32.026583 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-1b34260c-5116-4cb8-bc05-0c839e7cad5b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 200 len: 38409 microversion: 2.20 time: 0.100620 Oct 28 12:32:32.028373 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 126/260] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:32:31 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 38409 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:32:32.047953 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-9562624b-dc9f-4a33-a9dc-e22dbc4a5532 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:32.049033 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-9562624b-dc9f-4a33-a9dc-e22dbc4a5532 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:32.064850 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9562624b-dc9f-4a33-a9dc-e22dbc4a5532 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:32.065626 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9562624b-dc9f-4a33-a9dc-e22dbc4a5532 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:32.066983 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9562624b-dc9f-4a33-a9dc-e22dbc4a5532 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:32.067748 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9562624b-dc9f-4a33-a9dc-e22dbc4a5532 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:32.107679 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-9562624b-dc9f-4a33-a9dc-e22dbc4a5532 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/ips" status: 200 len: 152 microversion: 2.20 time: 0.067043 Oct 28 12:32:32.110473 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-782a0d61-a5ad-40ec-abed-b87c5073e889 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:32.111984 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-782a0d61-a5ad-40ec-abed-b87c5073e889 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:32.114001 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 135/261] 10.222.0.62 () {60 vars in 1288 bytes} [Thu Oct 28 12:32:32 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/ips => generated 152 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:32:32.122052 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-782a0d61-a5ad-40ec-abed-b87c5073e889 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:32.122732 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-782a0d61-a5ad-40ec-abed-b87c5073e889 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:32.123669 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-782a0d61-a5ad-40ec-abed-b87c5073e889 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:32.124245 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-782a0d61-a5ad-40ec-abed-b87c5073e889 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:32.249867 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-782a0d61-a5ad-40ec-abed-b87c5073e889 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 200 len: 38261 microversion: 2.1 time: 0.144677 Oct 28 12:32:32.250899 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 127/262] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:32:32 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 38261 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:32:32.262217 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-b617a133-6d4e-4ffe-8fb6-b8e1a8073e11 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:32.262915 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-b617a133-6d4e-4ffe-8fb6-b8e1a8073e11 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:32.271412 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b617a133-6d4e-4ffe-8fb6-b8e1a8073e11 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:32.272325 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b617a133-6d4e-4ffe-8fb6-b8e1a8073e11 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:32.273623 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b617a133-6d4e-4ffe-8fb6-b8e1a8073e11 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:32.274430 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b617a133-6d4e-4ffe-8fb6-b8e1a8073e11 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:32.317080 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-b617a133-6d4e-4ffe-8fb6-b8e1a8073e11 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/ips" status: 200 len: 145 microversion: 2.1 time: 0.059221 Oct 28 12:32:32.319041 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 136/263] 10.222.0.62 () {58 vars in 1247 bytes} [Thu Oct 28 12:32:32 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/ips => generated 145 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:32:32.462173 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-a989198b-ceb1-4da1-b8bf-50c62dcf79ed req-ed24970f-4d03-4ebb-9d9b-996232cae83b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9dc74b0-0412-4f1d-ba9f-18c7b792df75", "tag": "b39e2281-2702-459d-917b-89f8a06e12f4"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:32.471667 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:32:32.471667 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:32:32.483261 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-a989198b-ceb1-4da1-b8bf-50c62dcf79ed req-ed24970f-4d03-4ebb-9d9b-996232cae83b service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:32.483963 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-a989198b-ceb1-4da1-b8bf-50c62dcf79ed req-ed24970f-4d03-4ebb-9d9b-996232cae83b service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:32.498157 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-a989198b-ceb1-4da1-b8bf-50c62dcf79ed req-ed24970f-4d03-4ebb-9d9b-996232cae83b service nova] Creating event network-changed:b39e2281-2702-459d-917b-89f8a06e12f4 for instance e9dc74b0-0412-4f1d-ba9f-18c7b792df75 on hv-cinder-81514 Oct 28 12:32:32.503197 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-a989198b-ceb1-4da1-b8bf-50c62dcf79ed req-ed24970f-4d03-4ebb-9d9b-996232cae83b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048929 Oct 28 12:32:32.504098 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 128/264] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:32:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:32:32.576492 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-05646b8d-19cb-49ca-afec-007e32cc3de6 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:32.577090 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-05646b8d-19cb-49ca-afec-007e32cc3de6 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] [instance: 2c2b85ef-76d8-4707-83a5-5a83394b80df] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:32.583093 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-05646b8d-19cb-49ca-afec-007e32cc3de6 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:32.583526 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-05646b8d-19cb-49ca-afec-007e32cc3de6 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:32.584284 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-05646b8d-19cb-49ca-afec-007e32cc3de6 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:32.584899 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-05646b8d-19cb-49ca-afec-007e32cc3de6 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:32.685022 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-f1f17330-c263-4be9-8f08-3bacb8120007 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:32.685744 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-f1f17330-c263-4be9-8f08-3bacb8120007 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: e9dc74b0-0412-4f1d-ba9f-18c7b792df75] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:32.691861 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f1f17330-c263-4be9-8f08-3bacb8120007 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:32.692533 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f1f17330-c263-4be9-8f08-3bacb8120007 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:32.693319 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f1f17330-c263-4be9-8f08-3bacb8120007 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:32.693901 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f1f17330-c263-4be9-8f08-3bacb8120007 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:32.882727 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-05646b8d-19cb-49ca-afec-007e32cc3de6 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c0f7f787ad4496809a5015b221cb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0885f209fd8c4c39a508059798fec9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:32.926880 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-05646b8d-19cb-49ca-afec-007e32cc3de6 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] 10.222.0.62 "GET /compute/v2.1/servers/2c2b85ef-76d8-4707-83a5-5a83394b80df" status: 200 len: 1314 microversion: 2.1 time: 0.350518 Oct 28 12:32:32.928411 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 137/265] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:32 2021] GET /compute/v2.1/servers/2c2b85ef-76d8-4707-83a5-5a83394b80df => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:32.947445 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-e3eb9599-1010-480b-92e4-fed30e60f8ef tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:32.949273 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-e3eb9599-1010-480b-92e4-fed30e60f8ef tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:32.961349 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e3eb9599-1010-480b-92e4-fed30e60f8ef tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:32.962063 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e3eb9599-1010-480b-92e4-fed30e60f8ef tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:32.963096 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e3eb9599-1010-480b-92e4-fed30e60f8ef tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:32.963733 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e3eb9599-1010-480b-92e4-fed30e60f8ef tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:33.027188 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f1f17330-c263-4be9-8f08-3bacb8120007 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a27389ddb44f893f2975cab49ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94643fb6f71b47f79d194ad0849be625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:33.034999 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-f1f17330-c263-4be9-8f08-3bacb8120007 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "GET /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75" status: 200 len: 1319 microversion: 2.1 time: 0.355160 Oct 28 12:32:33.036057 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 129/266] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:32 2021] GET /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75 => generated 1319 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:33.149857 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-e3eb9599-1010-480b-92e4-fed30e60f8ef tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:33.158103 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-e3eb9599-1010-480b-92e4-fed30e60f8ef tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1566 microversion: 2.1 time: 0.225916 Oct 28 12:32:33.158900 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 138/267] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:32 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1566 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:33.949867 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-76e23617-63dd-4c88-9ad8-9345ec30ecde tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:33.950471 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-76e23617-63dd-4c88-9ad8-9345ec30ecde tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] [instance: 2c2b85ef-76d8-4707-83a5-5a83394b80df] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:33.957220 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-76e23617-63dd-4c88-9ad8-9345ec30ecde tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:33.957657 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-76e23617-63dd-4c88-9ad8-9345ec30ecde tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:33.958582 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-76e23617-63dd-4c88-9ad8-9345ec30ecde tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:33.959011 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-76e23617-63dd-4c88-9ad8-9345ec30ecde tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:34.051416 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-e4c54285-bb7e-4c16-9771-3c977a423663 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:34.052133 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-e4c54285-bb7e-4c16-9771-3c977a423663 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: e9dc74b0-0412-4f1d-ba9f-18c7b792df75] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:34.064383 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e4c54285-bb7e-4c16-9771-3c977a423663 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:34.064851 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e4c54285-bb7e-4c16-9771-3c977a423663 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:34.065958 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e4c54285-bb7e-4c16-9771-3c977a423663 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:34.066610 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e4c54285-bb7e-4c16-9771-3c977a423663 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:34.095190 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-76e23617-63dd-4c88-9ad8-9345ec30ecde tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c0f7f787ad4496809a5015b221cb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0885f209fd8c4c39a508059798fec9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:34.102613 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-76e23617-63dd-4c88-9ad8-9345ec30ecde tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] 10.222.0.62 "GET /compute/v2.1/servers/2c2b85ef-76d8-4707-83a5-5a83394b80df" status: 200 len: 1314 microversion: 2.1 time: 0.156752 Oct 28 12:32:34.103184 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 130/268] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:33 2021] GET /compute/v2.1/servers/2c2b85ef-76d8-4707-83a5-5a83394b80df => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:34.181694 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-8ffc51ae-051d-4a8f-b463-90492787a308 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:34.182719 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-8ffc51ae-051d-4a8f-b463-90492787a308 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:34.197380 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8ffc51ae-051d-4a8f-b463-90492787a308 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:34.198783 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8ffc51ae-051d-4a8f-b463-90492787a308 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:34.200997 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8ffc51ae-051d-4a8f-b463-90492787a308 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:34.202106 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8ffc51ae-051d-4a8f-b463-90492787a308 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:34.207505 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-e4c54285-bb7e-4c16-9771-3c977a423663 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a27389ddb44f893f2975cab49ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94643fb6f71b47f79d194ad0849be625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:34.218199 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-e4c54285-bb7e-4c16-9771-3c977a423663 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "GET /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75" status: 200 len: 1319 microversion: 2.1 time: 0.170429 Oct 28 12:32:34.231836 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 139/269] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:34 2021] GET /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:34.356146 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-8ffc51ae-051d-4a8f-b463-90492787a308 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:34.368549 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-8ffc51ae-051d-4a8f-b463-90492787a308 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1566 microversion: 2.1 time: 0.193830 Oct 28 12:32:34.369413 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 131/270] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:34 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1566 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:34.641395 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-19a8d0c3-37a9-4461-8d6d-5d7dc21274a5 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1582310357", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1357312688", "security_groups": [{"name": "tempest-secgroup-smoke-1509298390"}], "block_device_mapping_v2": [{"uuid": "fc5409b6-41ea-4162-9eab-a6f9f0705297", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "21386cb8-b310-4d7a-bddd-fd2d5b5b89a3"}]}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:34.658780 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-83aba961-4efe-4b66-beab-74a46c5446ec tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:34.659304 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-83aba961-4efe-4b66-beab-74a46c5446ec tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:34.665901 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-83aba961-4efe-4b66-beab-74a46c5446ec tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:34.666323 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-83aba961-4efe-4b66-beab-74a46c5446ec tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:34.667266 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-83aba961-4efe-4b66-beab-74a46c5446ec tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:34.667835 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-83aba961-4efe-4b66-beab-74a46c5446ec tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:34.694303 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.objects.instance [None req-83aba961-4efe-4b66-beab-74a46c5446ec tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lazy-loading 'flavor' on Instance uuid f6a3a830-8175-434e-8c23-336ccacf7ef8 {{(pid=115876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:32:34.747285 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.network.neutron [None req-19a8d0c3-37a9-4461-8d6d-5d7dc21274a5 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] validate_networks() for [('21386cb8-b310-4d7a-bddd-fd2d5b5b89a3', None, None, None, None, None)] {{(pid=115877) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:32:35.120780 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-83aba961-4efe-4b66-beab-74a46c5446ec tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 202 len: 0 microversion: 2.20 time: 0.465836 Oct 28 12:32:35.123089 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 132/271] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:32:34 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:32:35.131016 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-dc587f11-c3c5-435e-91be-b3fe8395c818 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:35.133047 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-dc587f11-c3c5-435e-91be-b3fe8395c818 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] [instance: 2c2b85ef-76d8-4707-83a5-5a83394b80df] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:35.143527 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-dc587f11-c3c5-435e-91be-b3fe8395c818 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:35.144464 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-dc587f11-c3c5-435e-91be-b3fe8395c818 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:35.145718 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-dc587f11-c3c5-435e-91be-b3fe8395c818 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:35.146375 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-dc587f11-c3c5-435e-91be-b3fe8395c818 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:35.313667 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-19a8d0c3-37a9-4461-8d6d-5d7dc21274a5 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Flavor limits 0:0:0 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:32:35.314133 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-19a8d0c3-37a9-4461-8d6d-5d7dc21274a5 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Image limits 0:0:0 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:32:35.314537 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-19a8d0c3-37a9-4461-8d6d-5d7dc21274a5 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Flavor pref 0:0:0 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:32:35.314933 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-19a8d0c3-37a9-4461-8d6d-5d7dc21274a5 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Image pref 0:0:0 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:32:35.315330 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-19a8d0c3-37a9-4461-8d6d-5d7dc21274a5 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:32:35.326879 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-19a8d0c3-37a9-4461-8d6d-5d7dc21274a5 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:35.327678 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-19a8d0c3-37a9-4461-8d6d-5d7dc21274a5 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:35.328130 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-19a8d0c3-37a9-4461-8d6d-5d7dc21274a5 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:35.328562 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-19a8d0c3-37a9-4461-8d6d-5d7dc21274a5 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:35.347792 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.quota [None req-19a8d0c3-37a9-4461-8d6d-5d7dc21274a5 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Getting quotas for project 70a330da99234af6b3a80df822d5067f. Resources: {'cores', 'instances', 'ram'} {{(pid=115877) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:32:35.353198 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.quota [None req-19a8d0c3-37a9-4461-8d6d-5d7dc21274a5 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Getting quotas for user 4303ee654346434cb52fa498176297b1 and project 70a330da99234af6b3a80df822d5067f. Resources: {'cores', 'instances', 'ram'} {{(pid=115877) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:32:35.357649 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-dc587f11-c3c5-435e-91be-b3fe8395c818 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c0f7f787ad4496809a5015b221cb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0885f209fd8c4c39a508059798fec9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:35.366898 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-dc587f11-c3c5-435e-91be-b3fe8395c818 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] 10.222.0.62 "GET /compute/v2.1/servers/2c2b85ef-76d8-4707-83a5-5a83394b80df" status: 200 len: 1314 microversion: 2.1 time: 0.241419 Oct 28 12:32:35.367551 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 133/272] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:35 2021] GET /compute/v2.1/servers/2c2b85ef-76d8-4707-83a5-5a83394b80df => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:35.376486 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-20035133-e47d-4e23-8688-fd03385f50e9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:35.377121 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-20035133-e47d-4e23-8688-fd03385f50e9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:35.383675 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-20035133-e47d-4e23-8688-fd03385f50e9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:35.384109 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-20035133-e47d-4e23-8688-fd03385f50e9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:35.385348 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-20035133-e47d-4e23-8688-fd03385f50e9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:35.385782 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-20035133-e47d-4e23-8688-fd03385f50e9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:35.418353 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-19a8d0c3-37a9-4461-8d6d-5d7dc21274a5 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Going to run 1 instances... {{(pid=115877) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:32:35.420824 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-19a8d0c3-37a9-4461-8d6d-5d7dc21274a5 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a02b0570-d3b8-4fe1-aa09-199f6525ac0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fc5409b6-41ea-4162-9eab-a6f9f0705297',volume_size=None,volume_type=None)] {{(pid=115877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:32:35.549592 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-20035133-e47d-4e23-8688-fd03385f50e9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:35.578107 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-20035133-e47d-4e23-8688-fd03385f50e9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:35.579800 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-20035133-e47d-4e23-8688-fd03385f50e9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:35.581771 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-20035133-e47d-4e23-8688-fd03385f50e9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1724 microversion: 2.20 time: 0.212456 Oct 28 12:32:35.582449 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 134/273] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:32:35 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:32:35.587274 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-9b755104-ccee-4749-a947-5cdde48b8805 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:35.588105 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-9b755104-ccee-4749-a947-5cdde48b8805 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: e9dc74b0-0412-4f1d-ba9f-18c7b792df75] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:35.596242 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9b755104-ccee-4749-a947-5cdde48b8805 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:35.597247 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9b755104-ccee-4749-a947-5cdde48b8805 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:35.598443 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9b755104-ccee-4749-a947-5cdde48b8805 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:35.599065 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9b755104-ccee-4749-a947-5cdde48b8805 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:35.635770 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-19a8d0c3-37a9-4461-8d6d-5d7dc21274a5 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.998291 Oct 28 12:32:35.642292 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 140/274] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Oct 28 12:32:34 2021] POST /compute/v2.1/servers => generated 406 bytes in 1006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 12:32:35.663790 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-2bf522ba-2716-4015-975b-a378655986b1 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:35.664398 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-2bf522ba-2716-4015-975b-a378655986b1 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:35.676116 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2bf522ba-2716-4015-975b-a378655986b1 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:35.676934 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2bf522ba-2716-4015-975b-a378655986b1 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:35.678189 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2bf522ba-2716-4015-975b-a378655986b1 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:35.678810 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2bf522ba-2716-4015-975b-a378655986b1 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:35.766304 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-9b755104-ccee-4749-a947-5cdde48b8805 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a27389ddb44f893f2975cab49ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94643fb6f71b47f79d194ad0849be625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:35.774470 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-9b755104-ccee-4749-a947-5cdde48b8805 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "GET /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75" status: 200 len: 1319 microversion: 2.1 time: 0.190909 Oct 28 12:32:35.775120 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 135/275] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:35 2021] GET /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:35.780532 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-4f7e72c4-472c-4afe-8201-9cd2b07abef4 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ad11f67-ae87-43c8-9650-5b2f3ae8f110"}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:35.781684 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-4f7e72c4-472c-4afe-8201-9cd2b07abef4 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:35.788815 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4f7e72c4-472c-4afe-8201-9cd2b07abef4 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:35.788965 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4f7e72c4-472c-4afe-8201-9cd2b07abef4 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:35.789648 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4f7e72c4-472c-4afe-8201-9cd2b07abef4 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:35.790073 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4f7e72c4-472c-4afe-8201-9cd2b07abef4 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:35.911114 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-2bf522ba-2716-4015-975b-a378655986b1 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:35.927582 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-2bf522ba-2716-4015-975b-a378655986b1 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1566 microversion: 2.1 time: 0.281143 Oct 28 12:32:35.928862 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 141/276] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:35 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1566 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:35.934089 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-50eaec06-f017-413b-bd2a-4e44d938b489 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:35.934879 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-50eaec06-f017-413b-bd2a-4e44d938b489 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a02b0570-d3b8-4fe1-aa09-199f6525ac0c] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:36.041746 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-50eaec06-f017-413b-bd2a-4e44d938b489 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:36.057453 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-50eaec06-f017-413b-bd2a-4e44d938b489 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c" status: 200 len: 1095 microversion: 2.1 time: 0.126645 Oct 28 12:32:36.061371 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 142/277] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:35 2021] GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c => generated 1095 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:36.109555 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-4f7e72c4-472c-4afe-8201-9cd2b07abef4 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.332723 Oct 28 12:32:36.111494 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 136/278] 10.222.0.62 () {60 vars in 1322 bytes} [Thu Oct 28 12:32:35 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/os-volume_attachments => generated 194 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:32:36.387566 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-ebe81926-e984-4410-b18b-085080fb3f71 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:36.388324 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-ebe81926-e984-4410-b18b-085080fb3f71 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] [instance: 2c2b85ef-76d8-4707-83a5-5a83394b80df] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:36.394839 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ebe81926-e984-4410-b18b-085080fb3f71 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:36.395373 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ebe81926-e984-4410-b18b-085080fb3f71 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:36.396261 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ebe81926-e984-4410-b18b-085080fb3f71 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:36.396750 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ebe81926-e984-4410-b18b-085080fb3f71 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:36.542056 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-ebe81926-e984-4410-b18b-085080fb3f71 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c0f7f787ad4496809a5015b221cb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0885f209fd8c4c39a508059798fec9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:36.549990 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-ebe81926-e984-4410-b18b-085080fb3f71 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] 10.222.0.62 "GET /compute/v2.1/servers/2c2b85ef-76d8-4707-83a5-5a83394b80df" status: 200 len: 1314 microversion: 2.1 time: 0.166221 Oct 28 12:32:36.550507 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 143/279] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:36 2021] GET /compute/v2.1/servers/2c2b85ef-76d8-4707-83a5-5a83394b80df => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:36.600966 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-f42e15e6-62b3-4359-a508-70fef80a3126 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:36.601791 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-f42e15e6-62b3-4359-a508-70fef80a3126 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:36.608252 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f42e15e6-62b3-4359-a508-70fef80a3126 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:36.608662 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f42e15e6-62b3-4359-a508-70fef80a3126 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:36.609630 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f42e15e6-62b3-4359-a508-70fef80a3126 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:36.610217 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f42e15e6-62b3-4359-a508-70fef80a3126 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:36.750909 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f42e15e6-62b3-4359-a508-70fef80a3126 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:36.776744 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f42e15e6-62b3-4359-a508-70fef80a3126 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:36.779220 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f42e15e6-62b3-4359-a508-70fef80a3126 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:36.781850 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-f42e15e6-62b3-4359-a508-70fef80a3126 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1724 microversion: 2.20 time: 0.184675 Oct 28 12:32:36.783047 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 137/280] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:32:36 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:32:36.793391 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-c0d80c30-f9aa-49f3-847e-86718f1f1738 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:36.793992 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-c0d80c30-f9aa-49f3-847e-86718f1f1738 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: e9dc74b0-0412-4f1d-ba9f-18c7b792df75] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:36.803302 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c0d80c30-f9aa-49f3-847e-86718f1f1738 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:36.803973 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c0d80c30-f9aa-49f3-847e-86718f1f1738 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:36.805962 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c0d80c30-f9aa-49f3-847e-86718f1f1738 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:36.805962 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c0d80c30-f9aa-49f3-847e-86718f1f1738 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:36.949262 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-af4d0ad9-341a-40cf-a059-d981cab60736 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:36.950685 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-af4d0ad9-341a-40cf-a059-d981cab60736 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:36.960234 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-af4d0ad9-341a-40cf-a059-d981cab60736 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:36.960975 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-af4d0ad9-341a-40cf-a059-d981cab60736 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:36.962271 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-af4d0ad9-341a-40cf-a059-d981cab60736 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:36.962907 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-af4d0ad9-341a-40cf-a059-d981cab60736 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:37.132393 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-c0d80c30-f9aa-49f3-847e-86718f1f1738 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a27389ddb44f893f2975cab49ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94643fb6f71b47f79d194ad0849be625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:37.147699 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-c0d80c30-f9aa-49f3-847e-86718f1f1738 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "GET /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75" status: 200 len: 1319 microversion: 2.1 time: 0.360087 Oct 28 12:32:37.150073 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 144/281] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:36 2021] GET /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75 => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:37.164355 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-9007aa36-9754-4819-8663-14f87a4f1812 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:37.165952 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-9007aa36-9754-4819-8663-14f87a4f1812 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a02b0570-d3b8-4fe1-aa09-199f6525ac0c] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:37.176225 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9007aa36-9754-4819-8663-14f87a4f1812 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:37.177680 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9007aa36-9754-4819-8663-14f87a4f1812 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:37.178722 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9007aa36-9754-4819-8663-14f87a4f1812 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:37.179272 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9007aa36-9754-4819-8663-14f87a4f1812 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:37.291057 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-af4d0ad9-341a-40cf-a059-d981cab60736 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:37.299901 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-af4d0ad9-341a-40cf-a059-d981cab60736 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1566 microversion: 2.1 time: 0.357628 Oct 28 12:32:37.301477 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 138/282] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:36 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1566 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:32:37.315766 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-9007aa36-9754-4819-8663-14f87a4f1812 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:37.323466 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-9007aa36-9754-4819-8663-14f87a4f1812 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c" status: 200 len: 1211 microversion: 2.1 time: 0.171865 Oct 28 12:32:37.324055 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 145/283] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:37 2021] GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c => generated 1211 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:37.421975 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-fb4156fa-7b54-4cc0-bd45-fecdb57070c9 req-155a7f06-5427-4695-84e7-594387c5d7ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2b85ef-76d8-4707-83a5-5a83394b80df", "name": "network-vif-plugged", "status": "completed", "tag": "7c81d3d4-a1e4-4e95-b3ef-ec5660cf0f30"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:37.423807 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:32:37.423807 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:32:37.432844 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-fb4156fa-7b54-4cc0-bd45-fecdb57070c9 req-155a7f06-5427-4695-84e7-594387c5d7ef service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:37.433812 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-fb4156fa-7b54-4cc0-bd45-fecdb57070c9 req-155a7f06-5427-4695-84e7-594387c5d7ef service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:37.450035 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-fb4156fa-7b54-4cc0-bd45-fecdb57070c9 req-155a7f06-5427-4695-84e7-594387c5d7ef service nova] Creating event network-vif-plugged:7c81d3d4-a1e4-4e95-b3ef-ec5660cf0f30 for instance 2c2b85ef-76d8-4707-83a5-5a83394b80df on hv-cinder-81514 Oct 28 12:32:37.456960 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-fb4156fa-7b54-4cc0-bd45-fecdb57070c9 req-155a7f06-5427-4695-84e7-594387c5d7ef service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040304 Oct 28 12:32:37.457598 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 139/284] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:32:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:32:37.572259 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-9524bf45-9019-4796-8157-c241e825d768 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:37.574189 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-9524bf45-9019-4796-8157-c241e825d768 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] [instance: 2c2b85ef-76d8-4707-83a5-5a83394b80df] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:37.581261 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9524bf45-9019-4796-8157-c241e825d768 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:37.581989 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9524bf45-9019-4796-8157-c241e825d768 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:37.583010 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9524bf45-9019-4796-8157-c241e825d768 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:37.583512 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9524bf45-9019-4796-8157-c241e825d768 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:37.808935 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-9524bf45-9019-4796-8157-c241e825d768 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c0f7f787ad4496809a5015b221cb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0885f209fd8c4c39a508059798fec9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:37.809302 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-1c9c5604-faf1-4790-872e-0b084e7a77b8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:37.810662 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-1c9c5604-faf1-4790-872e-0b084e7a77b8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:37.819943 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1c9c5604-faf1-4790-872e-0b084e7a77b8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:37.820340 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1c9c5604-faf1-4790-872e-0b084e7a77b8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:37.821143 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1c9c5604-faf1-4790-872e-0b084e7a77b8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:37.821570 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1c9c5604-faf1-4790-872e-0b084e7a77b8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:37.828376 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-9524bf45-9019-4796-8157-c241e825d768 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] 10.222.0.62 "GET /compute/v2.1/servers/2c2b85ef-76d8-4707-83a5-5a83394b80df" status: 200 len: 1314 microversion: 2.1 time: 0.262779 Oct 28 12:32:37.828992 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 146/285] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:37 2021] GET /compute/v2.1/servers/2c2b85ef-76d8-4707-83a5-5a83394b80df => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:38.050953 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-1c9c5604-faf1-4790-872e-0b084e7a77b8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:38.059955 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-1c9c5604-faf1-4790-872e-0b084e7a77b8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:38.061456 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-1c9c5604-faf1-4790-872e-0b084e7a77b8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:38.062612 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-1c9c5604-faf1-4790-872e-0b084e7a77b8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1724 microversion: 2.20 time: 0.265984 Oct 28 12:32:38.063439 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 140/286] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:32:37 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:32:38.167109 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-0c03d4bf-9e4d-416e-b678-8165b1db75fe tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:38.167747 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-0c03d4bf-9e4d-416e-b678-8165b1db75fe tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: e9dc74b0-0412-4f1d-ba9f-18c7b792df75] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:38.174752 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0c03d4bf-9e4d-416e-b678-8165b1db75fe tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:38.175240 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0c03d4bf-9e4d-416e-b678-8165b1db75fe tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:38.176021 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0c03d4bf-9e4d-416e-b678-8165b1db75fe tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:38.176454 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0c03d4bf-9e4d-416e-b678-8165b1db75fe tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:38.319623 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-78a03aeb-fb25-47ae-9f50-aec1e292912f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:38.320319 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-78a03aeb-fb25-47ae-9f50-aec1e292912f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:38.328704 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-78a03aeb-fb25-47ae-9f50-aec1e292912f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:38.329548 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-78a03aeb-fb25-47ae-9f50-aec1e292912f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:38.331268 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-78a03aeb-fb25-47ae-9f50-aec1e292912f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:38.332074 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-78a03aeb-fb25-47ae-9f50-aec1e292912f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:38.624367 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-0c03d4bf-9e4d-416e-b678-8165b1db75fe tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a27389ddb44f893f2975cab49ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94643fb6f71b47f79d194ad0849be625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:38.632166 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-0c03d4bf-9e4d-416e-b678-8165b1db75fe tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "GET /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75" status: 200 len: 1319 microversion: 2.1 time: 0.468843 Oct 28 12:32:38.633008 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 147/287] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:38 2021] GET /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75 => generated 1319 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:38.638100 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-b0f62ae4-4089-4f28-be13-260067e0870b tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:38.638870 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-b0f62ae4-4089-4f28-be13-260067e0870b tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a02b0570-d3b8-4fe1-aa09-199f6525ac0c] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:38.645958 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b0f62ae4-4089-4f28-be13-260067e0870b tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:38.646627 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b0f62ae4-4089-4f28-be13-260067e0870b tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:38.647539 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b0f62ae4-4089-4f28-be13-260067e0870b tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:38.648246 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b0f62ae4-4089-4f28-be13-260067e0870b tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:38.675405 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-78a03aeb-fb25-47ae-9f50-aec1e292912f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:38.684037 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-78a03aeb-fb25-47ae-9f50-aec1e292912f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1566 microversion: 2.1 time: 0.367952 Oct 28 12:32:38.687352 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 141/288] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:38 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1566 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:38.693088 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-dfb034c0-531b-4654-a7f7-44110adc989f tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1790931446", "imageRef": "575f28c8-0af2-4973-b3d9-a249e2400c6e", "flavorRef": "452", "networks": [{"uuid": "f20ac26a-7429-439a-a4a0-e4320dff4b06"}]}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:38.756276 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.network.neutron [None req-dfb034c0-531b-4654-a7f7-44110adc989f tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] validate_networks() for [('f20ac26a-7429-439a-a4a0-e4320dff4b06', None, None, None, None, None)] {{(pid=115876) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:32:38.948104 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-b0f62ae4-4089-4f28-be13-260067e0870b tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:38.961350 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-b0f62ae4-4089-4f28-be13-260067e0870b tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c" status: 200 len: 1279 microversion: 2.1 time: 0.327107 Oct 28 12:32:38.962407 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 148/289] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:38 2021] GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c => generated 1279 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:38.968019 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-833d101c-4675-4064-87df-4c09de23eab9 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:38.969010 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-833d101c-4675-4064-87df-4c09de23eab9 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] [instance: 2c2b85ef-76d8-4707-83a5-5a83394b80df] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:38.978039 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-833d101c-4675-4064-87df-4c09de23eab9 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:38.978728 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-833d101c-4675-4064-87df-4c09de23eab9 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:38.979805 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-833d101c-4675-4064-87df-4c09de23eab9 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:38.980391 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-833d101c-4675-4064-87df-4c09de23eab9 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:39.330531 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-833d101c-4675-4064-87df-4c09de23eab9 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c0f7f787ad4496809a5015b221cb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0885f209fd8c4c39a508059798fec9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:39.338052 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-833d101c-4675-4064-87df-4c09de23eab9 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] 10.222.0.62 "GET /compute/v2.1/servers/2c2b85ef-76d8-4707-83a5-5a83394b80df" status: 200 len: 1314 microversion: 2.1 time: 0.373775 Oct 28 12:32:39.338625 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 149/290] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:38 2021] GET /compute/v2.1/servers/2c2b85ef-76d8-4707-83a5-5a83394b80df => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:39.343116 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-6bf5be7a-b58f-44b9-886d-f24d8b1a0c22 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:39.343713 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-6bf5be7a-b58f-44b9-886d-f24d8b1a0c22 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:39.352507 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6bf5be7a-b58f-44b9-886d-f24d8b1a0c22 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:39.352982 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6bf5be7a-b58f-44b9-886d-f24d8b1a0c22 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:39.354001 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6bf5be7a-b58f-44b9-886d-f24d8b1a0c22 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:39.354423 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6bf5be7a-b58f-44b9-886d-f24d8b1a0c22 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:39.625643 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-dfb034c0-531b-4654-a7f7-44110adc989f tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Flavor limits 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:32:39.626354 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-dfb034c0-531b-4654-a7f7-44110adc989f tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Image limits 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:32:39.627670 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-dfb034c0-531b-4654-a7f7-44110adc989f tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Flavor pref 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:32:39.628357 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-dfb034c0-531b-4654-a7f7-44110adc989f tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Image pref 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:32:39.628481 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-dfb034c0-531b-4654-a7f7-44110adc989f tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:32:39.647563 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-dfb034c0-531b-4654-a7f7-44110adc989f tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:39.648335 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-dfb034c0-531b-4654-a7f7-44110adc989f tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:39.649496 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-dfb034c0-531b-4654-a7f7-44110adc989f tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:39.650089 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-dfb034c0-531b-4654-a7f7-44110adc989f tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:39.668845 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-dfb034c0-531b-4654-a7f7-44110adc989f tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Getting quotas for project 2fbbbaba86b74b2184637e1cf58ec643. Resources: {'cores', 'instances', 'ram'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:32:39.672164 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-6bf5be7a-b58f-44b9-886d-f24d8b1a0c22 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:39.675200 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-dfb034c0-531b-4654-a7f7-44110adc989f tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Getting quotas for user 9342796ec00a4004be5d853d307a2411 and project 2fbbbaba86b74b2184637e1cf58ec643. Resources: {'cores', 'instances', 'ram'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:32:39.680733 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-6bf5be7a-b58f-44b9-886d-f24d8b1a0c22 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:39.682252 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-6bf5be7a-b58f-44b9-886d-f24d8b1a0c22 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:39.683788 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-6bf5be7a-b58f-44b9-886d-f24d8b1a0c22 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1724 microversion: 2.20 time: 0.343893 Oct 28 12:32:39.694974 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 150/291] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:32:39 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1724 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:32:39.695227 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-dfb034c0-531b-4654-a7f7-44110adc989f tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Going to run 1 instances... {{(pid=115876) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:32:39.695323 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-a27b0eb7-cc4e-4fcb-80a7-7217d2639f83 req-15ce76bb-8565-415d-9f75-dadb3492cb8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9dc74b0-0412-4f1d-ba9f-18c7b792df75", "name": "network-vif-plugged", "status": "completed", "tag": "b39e2281-2702-459d-917b-89f8a06e12f4"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:39.695323 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:32:39.695323 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:32:39.695523 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-dfb034c0-531b-4654-a7f7-44110adc989f tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 87852894-21ea-4345-ace1-3a0724e544e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='575f28c8-0af2-4973-b3d9-a249e2400c6e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:32:39.705038 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-a27b0eb7-cc4e-4fcb-80a7-7217d2639f83 req-15ce76bb-8565-415d-9f75-dadb3492cb8b service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:39.705479 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-a27b0eb7-cc4e-4fcb-80a7-7217d2639f83 req-15ce76bb-8565-415d-9f75-dadb3492cb8b service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:39.717888 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-a27b0eb7-cc4e-4fcb-80a7-7217d2639f83 req-15ce76bb-8565-415d-9f75-dadb3492cb8b service nova] Creating event network-vif-plugged:b39e2281-2702-459d-917b-89f8a06e12f4 for instance e9dc74b0-0412-4f1d-ba9f-18c7b792df75 on hv-cinder-81514 Oct 28 12:32:39.723108 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-a27b0eb7-cc4e-4fcb-80a7-7217d2639f83 req-15ce76bb-8565-415d-9f75-dadb3492cb8b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037116 Oct 28 12:32:39.724209 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 151/292] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:32:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:32:39.730117 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-a8634ed3-8fc3-4cdd-8235-e5aa47875ff8 req-4ed6417f-0e12-4b74-a4cc-c3ac39b81a3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a02b0570-d3b8-4fe1-aa09-199f6525ac0c", "tag": "d8c38e90-8225-4aaf-8322-139cc91fa0a9"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:39.732376 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:32:39.732376 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:32:39.749770 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-a8634ed3-8fc3-4cdd-8235-e5aa47875ff8 req-4ed6417f-0e12-4b74-a4cc-c3ac39b81a3f service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:39.750435 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-a8634ed3-8fc3-4cdd-8235-e5aa47875ff8 req-4ed6417f-0e12-4b74-a4cc-c3ac39b81a3f service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:39.751481 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-dfb034c0-531b-4654-a7f7-44110adc989f tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.062098 Oct 28 12:32:39.752210 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 142/293] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Oct 28 12:32:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 1064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 12:32:39.767878 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-62e1fb44-d1ce-4df0-bf54-1faae31d726c tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:39.773612 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-62e1fb44-d1ce-4df0-bf54-1faae31d726c tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: e9dc74b0-0412-4f1d-ba9f-18c7b792df75] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:39.776659 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-a8634ed3-8fc3-4cdd-8235-e5aa47875ff8 req-4ed6417f-0e12-4b74-a4cc-c3ac39b81a3f service nova] Creating event network-changed:d8c38e90-8225-4aaf-8322-139cc91fa0a9 for instance a02b0570-d3b8-4fe1-aa09-199f6525ac0c on hv-cinder-81514 Oct 28 12:32:39.782704 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-62e1fb44-d1ce-4df0-bf54-1faae31d726c tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:39.782992 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-a8634ed3-8fc3-4cdd-8235-e5aa47875ff8 req-4ed6417f-0e12-4b74-a4cc-c3ac39b81a3f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056917 Oct 28 12:32:39.783138 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-62e1fb44-d1ce-4df0-bf54-1faae31d726c tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:39.783922 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-62e1fb44-d1ce-4df0-bf54-1faae31d726c tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:39.784052 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 152/294] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:32:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:32:39.784355 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-62e1fb44-d1ce-4df0-bf54-1faae31d726c tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:39.789644 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-61e1187f-44d4-4cbf-9d87-b3b15aff4a63 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:39.790343 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-61e1187f-44d4-4cbf-9d87-b3b15aff4a63 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:39.797458 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-61e1187f-44d4-4cbf-9d87-b3b15aff4a63 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:39.797903 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-61e1187f-44d4-4cbf-9d87-b3b15aff4a63 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:39.799243 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-61e1187f-44d4-4cbf-9d87-b3b15aff4a63 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:39.799243 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-61e1187f-44d4-4cbf-9d87-b3b15aff4a63 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:40.072659 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-62e1fb44-d1ce-4df0-bf54-1faae31d726c tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a27389ddb44f893f2975cab49ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94643fb6f71b47f79d194ad0849be625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:40.080242 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-61e1187f-44d4-4cbf-9d87-b3b15aff4a63 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:40.084061 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-62e1fb44-d1ce-4df0-bf54-1faae31d726c tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "GET /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75" status: 200 len: 1319 microversion: 2.1 time: 0.330505 Oct 28 12:32:40.084645 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 143/295] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:39 2021] GET /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75 => generated 1319 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:40.089867 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-a43b312c-807f-4cf1-bdf9-53ca1fb4f0d7 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:40.090690 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-a43b312c-807f-4cf1-bdf9-53ca1fb4f0d7 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 87852894-21ea-4345-ace1-3a0724e544e9] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:40.092119 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-61e1187f-44d4-4cbf-9d87-b3b15aff4a63 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1566 microversion: 2.1 time: 0.305148 Oct 28 12:32:40.093032 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 153/296] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:39 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1566 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:40.098120 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-64c19f60-10d1-4861-9f01-7a3614abda92 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:40.099002 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-64c19f60-10d1-4861-9f01-7a3614abda92 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a02b0570-d3b8-4fe1-aa09-199f6525ac0c] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:40.105045 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-64c19f60-10d1-4861-9f01-7a3614abda92 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:40.105483 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-64c19f60-10d1-4861-9f01-7a3614abda92 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:40.106258 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-64c19f60-10d1-4861-9f01-7a3614abda92 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:40.107604 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-64c19f60-10d1-4861-9f01-7a3614abda92 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:40.152448 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-a43b312c-807f-4cf1-bdf9-53ca1fb4f0d7 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9342796ec00a4004be5d853d307a2411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbbbaba86b74b2184637e1cf58ec643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:40.159692 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-a43b312c-807f-4cf1-bdf9-53ca1fb4f0d7 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/87852894-21ea-4345-ace1-3a0724e544e9" status: 200 len: 1214 microversion: 2.1 time: 0.073663 Oct 28 12:32:40.160365 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 144/297] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:40 2021] GET /compute/v2.1/servers/87852894-21ea-4345-ace1-3a0724e544e9 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:40.258077 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-64c19f60-10d1-4861-9f01-7a3614abda92 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:40.268743 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-64c19f60-10d1-4861-9f01-7a3614abda92 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c" status: 200 len: 1279 microversion: 2.1 time: 0.174366 Oct 28 12:32:40.269343 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 154/298] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:40 2021] GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c => generated 1279 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:40.358390 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-cdafc00c-3bbd-474e-ae69-15f8a353dde4 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:40.358993 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-cdafc00c-3bbd-474e-ae69-15f8a353dde4 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] [instance: 2c2b85ef-76d8-4707-83a5-5a83394b80df] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:40.366292 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cdafc00c-3bbd-474e-ae69-15f8a353dde4 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:40.366720 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cdafc00c-3bbd-474e-ae69-15f8a353dde4 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:40.367571 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cdafc00c-3bbd-474e-ae69-15f8a353dde4 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:40.368023 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cdafc00c-3bbd-474e-ae69-15f8a353dde4 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:40.605934 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-cdafc00c-3bbd-474e-ae69-15f8a353dde4 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c0f7f787ad4496809a5015b221cb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0885f209fd8c4c39a508059798fec9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:40.612917 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-cdafc00c-3bbd-474e-ae69-15f8a353dde4 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] 10.222.0.62 "GET /compute/v2.1/servers/2c2b85ef-76d8-4707-83a5-5a83394b80df" status: 200 len: 1463 microversion: 2.1 time: 0.260077 Oct 28 12:32:40.613499 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 145/299] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:40 2021] GET /compute/v2.1/servers/2c2b85ef-76d8-4707-83a5-5a83394b80df => generated 1463 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:40.652210 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-5d8cac78-b05b-4e49-a006-da6f73baa179 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:40.653100 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-5d8cac78-b05b-4e49-a006-da6f73baa179 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] [instance: 2c2b85ef-76d8-4707-83a5-5a83394b80df] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:40.659833 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5d8cac78-b05b-4e49-a006-da6f73baa179 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:40.660431 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5d8cac78-b05b-4e49-a006-da6f73baa179 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:40.661219 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5d8cac78-b05b-4e49-a006-da6f73baa179 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:40.661730 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5d8cac78-b05b-4e49-a006-da6f73baa179 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:40.688333 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-5d8cac78-b05b-4e49-a006-da6f73baa179 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] [instance: 2c2b85ef-76d8-4707-83a5-5a83394b80df] Going to try to terminate instance {{(pid=115877) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:32:40.703451 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-2a5a5396-38d8-4cdc-8c6a-c12ec0383ed9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:40.704422 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-2a5a5396-38d8-4cdc-8c6a-c12ec0383ed9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:40.711441 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2a5a5396-38d8-4cdc-8c6a-c12ec0383ed9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:40.711874 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2a5a5396-38d8-4cdc-8c6a-c12ec0383ed9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:40.713077 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2a5a5396-38d8-4cdc-8c6a-c12ec0383ed9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:40.713192 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2a5a5396-38d8-4cdc-8c6a-c12ec0383ed9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:40.772697 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-5d8cac78-b05b-4e49-a006-da6f73baa179 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] 10.222.0.62 "DELETE /compute/v2.1/servers/2c2b85ef-76d8-4707-83a5-5a83394b80df" status: 204 len: 0 microversion: 2.1 time: 0.124213 Oct 28 12:32:40.773437 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 155/300] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Oct 28 12:32:40 2021] DELETE /compute/v2.1/servers/2c2b85ef-76d8-4707-83a5-5a83394b80df => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:32:40.786223 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-1302d881-1e0d-47e9-acbd-cf6bf84c64f2 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:40.787475 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-1302d881-1e0d-47e9-acbd-cf6bf84c64f2 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] [instance: 2c2b85ef-76d8-4707-83a5-5a83394b80df] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:40.796211 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1302d881-1e0d-47e9-acbd-cf6bf84c64f2 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:40.796933 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1302d881-1e0d-47e9-acbd-cf6bf84c64f2 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:40.798379 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1302d881-1e0d-47e9-acbd-cf6bf84c64f2 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:40.798900 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1302d881-1e0d-47e9-acbd-cf6bf84c64f2 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:40.958831 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-2a5a5396-38d8-4cdc-8c6a-c12ec0383ed9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:40.966881 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-2a5a5396-38d8-4cdc-8c6a-c12ec0383ed9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:40.968379 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-2a5a5396-38d8-4cdc-8c6a-c12ec0383ed9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:40.969578 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-2a5a5396-38d8-4cdc-8c6a-c12ec0383ed9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1724 microversion: 2.20 time: 0.270639 Oct 28 12:32:40.970125 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 146/301] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:32:40 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1724 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:32:41.020130 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-1302d881-1e0d-47e9-acbd-cf6bf84c64f2 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c0f7f787ad4496809a5015b221cb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0885f209fd8c4c39a508059798fec9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:41.028014 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-1302d881-1e0d-47e9-acbd-cf6bf84c64f2 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] 10.222.0.62 "GET /compute/v2.1/servers/2c2b85ef-76d8-4707-83a5-5a83394b80df" status: 200 len: 1469 microversion: 2.1 time: 0.248255 Oct 28 12:32:41.028577 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 156/302] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:40 2021] GET /compute/v2.1/servers/2c2b85ef-76d8-4707-83a5-5a83394b80df => generated 1469 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:41.101363 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-e10412b2-fa5f-4b94-b51f-8301520dc3b4 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:41.102214 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-e10412b2-fa5f-4b94-b51f-8301520dc3b4 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: e9dc74b0-0412-4f1d-ba9f-18c7b792df75] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:41.110138 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-09de4218-ce0f-45d7-a0dd-5e2440e29ed7 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:41.110864 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-09de4218-ce0f-45d7-a0dd-5e2440e29ed7 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:41.112971 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e10412b2-fa5f-4b94-b51f-8301520dc3b4 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:41.113438 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e10412b2-fa5f-4b94-b51f-8301520dc3b4 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:41.117446 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-09de4218-ce0f-45d7-a0dd-5e2440e29ed7 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:41.118001 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-09de4218-ce0f-45d7-a0dd-5e2440e29ed7 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:41.118885 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-09de4218-ce0f-45d7-a0dd-5e2440e29ed7 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:41.119498 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-09de4218-ce0f-45d7-a0dd-5e2440e29ed7 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:41.120485 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e10412b2-fa5f-4b94-b51f-8301520dc3b4 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:41.120975 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e10412b2-fa5f-4b94-b51f-8301520dc3b4 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:41.457057 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-09de4218-ce0f-45d7-a0dd-5e2440e29ed7 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:41.462599 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-e10412b2-fa5f-4b94-b51f-8301520dc3b4 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a27389ddb44f893f2975cab49ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94643fb6f71b47f79d194ad0849be625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:41.468692 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-09de4218-ce0f-45d7-a0dd-5e2440e29ed7 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1566 microversion: 2.1 time: 0.361507 Oct 28 12:32:41.469675 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 157/303] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:41 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1566 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:41.475568 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-e10412b2-fa5f-4b94-b51f-8301520dc3b4 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "GET /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75" status: 200 len: 1319 microversion: 2.1 time: 0.374334 Oct 28 12:32:41.475932 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-fe5e16da-5b14-4a45-b010-63fcdcaa7ec3 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:41.476659 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-fe5e16da-5b14-4a45-b010-63fcdcaa7ec3 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 87852894-21ea-4345-ace1-3a0724e544e9] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:41.477037 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 147/304] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:41 2021] GET /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75 => generated 1319 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:41.483865 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fe5e16da-5b14-4a45-b010-63fcdcaa7ec3 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:41.484585 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fe5e16da-5b14-4a45-b010-63fcdcaa7ec3 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:41.485615 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fe5e16da-5b14-4a45-b010-63fcdcaa7ec3 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:41.486100 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fe5e16da-5b14-4a45-b010-63fcdcaa7ec3 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:41.487325 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-7a6b9a04-0910-4468-82ec-4872731da5da tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:41.489504 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-7a6b9a04-0910-4468-82ec-4872731da5da tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a02b0570-d3b8-4fe1-aa09-199f6525ac0c] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:41.504700 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7a6b9a04-0910-4468-82ec-4872731da5da tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:41.506016 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7a6b9a04-0910-4468-82ec-4872731da5da tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:41.508143 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7a6b9a04-0910-4468-82ec-4872731da5da tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:41.509263 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7a6b9a04-0910-4468-82ec-4872731da5da tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:41.582909 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-fe5e16da-5b14-4a45-b010-63fcdcaa7ec3 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9342796ec00a4004be5d853d307a2411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbbbaba86b74b2184637e1cf58ec643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:41.591707 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-fe5e16da-5b14-4a45-b010-63fcdcaa7ec3 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/87852894-21ea-4345-ace1-3a0724e544e9" status: 200 len: 1272 microversion: 2.1 time: 0.120441 Oct 28 12:32:41.607300 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 158/305] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:41 2021] GET /compute/v2.1/servers/87852894-21ea-4345-ace1-3a0724e544e9 => generated 1272 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:41.733432 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-7a6b9a04-0910-4468-82ec-4872731da5da tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:41.742090 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-7a6b9a04-0910-4468-82ec-4872731da5da tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c" status: 200 len: 1279 microversion: 2.1 time: 0.263793 Oct 28 12:32:41.742679 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 148/306] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:41 2021] GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c => generated 1279 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:41.987964 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-b29748f0-90a4-4089-8a5e-2b984ffc5d2c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:41.988532 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-b29748f0-90a4-4089-8a5e-2b984ffc5d2c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:41.996197 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b29748f0-90a4-4089-8a5e-2b984ffc5d2c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:41.996619 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b29748f0-90a4-4089-8a5e-2b984ffc5d2c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:41.997670 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b29748f0-90a4-4089-8a5e-2b984ffc5d2c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:41.998117 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b29748f0-90a4-4089-8a5e-2b984ffc5d2c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:42.046602 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-9b3a64c3-f3c9-4ff8-be72-b09cbf19f477 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:42.047177 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-9b3a64c3-f3c9-4ff8-be72-b09cbf19f477 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] [instance: 2c2b85ef-76d8-4707-83a5-5a83394b80df] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:42.062681 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9b3a64c3-f3c9-4ff8-be72-b09cbf19f477 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:42.063159 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9b3a64c3-f3c9-4ff8-be72-b09cbf19f477 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:42.064019 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9b3a64c3-f3c9-4ff8-be72-b09cbf19f477 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:42.064455 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9b3a64c3-f3c9-4ff8-be72-b09cbf19f477 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:42.460511 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-9b3a64c3-f3c9-4ff8-be72-b09cbf19f477 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c0f7f787ad4496809a5015b221cb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0885f209fd8c4c39a508059798fec9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:42.467753 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-b29748f0-90a4-4089-8a5e-2b984ffc5d2c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:42.471852 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-9b3a64c3-f3c9-4ff8-be72-b09cbf19f477 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] 10.222.0.62 "GET /compute/v2.1/servers/2c2b85ef-76d8-4707-83a5-5a83394b80df" status: 200 len: 1469 microversion: 2.1 time: 0.429160 Oct 28 12:32:42.477510 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-b29748f0-90a4-4089-8a5e-2b984ffc5d2c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:42.479347 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-b29748f0-90a4-4089-8a5e-2b984ffc5d2c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:42.480512 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-b29748f0-90a4-4089-8a5e-2b984ffc5d2c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1724 microversion: 2.20 time: 0.496605 Oct 28 12:32:42.481639 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 159/307] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:32:41 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1724 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:32:42.486670 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-d48d732d-ab7c-4904-89ff-bfa585d11fb4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:42.487458 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-d48d732d-ab7c-4904-89ff-bfa585d11fb4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:42.488341 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 149/308] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:42 2021] GET /compute/v2.1/servers/2c2b85ef-76d8-4707-83a5-5a83394b80df => generated 1469 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:32:42.497234 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d48d732d-ab7c-4904-89ff-bfa585d11fb4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:42.498011 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d48d732d-ab7c-4904-89ff-bfa585d11fb4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:42.498798 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d48d732d-ab7c-4904-89ff-bfa585d11fb4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:42.499532 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d48d732d-ab7c-4904-89ff-bfa585d11fb4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:42.506627 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-2097c4a1-5f19-46ea-bc42-3dd34b1d6aa1 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:42.507649 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-2097c4a1-5f19-46ea-bc42-3dd34b1d6aa1 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: e9dc74b0-0412-4f1d-ba9f-18c7b792df75] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:42.513923 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2097c4a1-5f19-46ea-bc42-3dd34b1d6aa1 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:42.514751 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2097c4a1-5f19-46ea-bc42-3dd34b1d6aa1 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:42.516080 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2097c4a1-5f19-46ea-bc42-3dd34b1d6aa1 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:42.517558 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2097c4a1-5f19-46ea-bc42-3dd34b1d6aa1 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:42.760742 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-d48d732d-ab7c-4904-89ff-bfa585d11fb4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:42.773998 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-d48d732d-ab7c-4904-89ff-bfa585d11fb4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1566 microversion: 2.1 time: 0.290773 Oct 28 12:32:42.776129 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-2097c4a1-5f19-46ea-bc42-3dd34b1d6aa1 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a27389ddb44f893f2975cab49ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94643fb6f71b47f79d194ad0849be625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:42.784098 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-2097c4a1-5f19-46ea-bc42-3dd34b1d6aa1 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "GET /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75" status: 200 len: 1508 microversion: 2.1 time: 0.294578 Oct 28 12:32:42.784768 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 150/309] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:42 2021] GET /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75 => generated 1508 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:42.786041 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 160/310] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:42 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1566 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:42.791014 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-a3bdfbd3-67f7-4b92-8122-39833a3cdc0a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:42.791869 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-a3bdfbd3-67f7-4b92-8122-39833a3cdc0a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a02b0570-d3b8-4fe1-aa09-199f6525ac0c] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:42.800880 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-8c6af6a2-4d35-4edd-ab55-4ff07625392e tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:42.801693 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-8c6af6a2-4d35-4edd-ab55-4ff07625392e tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 87852894-21ea-4345-ace1-3a0724e544e9] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:42.812671 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8c6af6a2-4d35-4edd-ab55-4ff07625392e tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:42.813229 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8c6af6a2-4d35-4edd-ab55-4ff07625392e tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:42.814278 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8c6af6a2-4d35-4edd-ab55-4ff07625392e tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:42.814914 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8c6af6a2-4d35-4edd-ab55-4ff07625392e tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:42.823592 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a3bdfbd3-67f7-4b92-8122-39833a3cdc0a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:42.823592 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a3bdfbd3-67f7-4b92-8122-39833a3cdc0a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:42.829378 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a3bdfbd3-67f7-4b92-8122-39833a3cdc0a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:42.829873 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a3bdfbd3-67f7-4b92-8122-39833a3cdc0a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:43.062906 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-8c6af6a2-4d35-4edd-ab55-4ff07625392e tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9342796ec00a4004be5d853d307a2411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbbbaba86b74b2184637e1cf58ec643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:43.068172 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-a3bdfbd3-67f7-4b92-8122-39833a3cdc0a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:43.075853 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-a3bdfbd3-67f7-4b92-8122-39833a3cdc0a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c" status: 200 len: 1279 microversion: 2.1 time: 0.288388 Oct 28 12:32:43.086019 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 161/311] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:42 2021] GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c => generated 1279 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:43.090805 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-8e68b8d6-8a18-45bc-962b-236b97180846 req-ae0f09c9-fd6f-499b-ab04-df44ce8b2946 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87852894-21ea-4345-ace1-3a0724e544e9", "tag": "31bae4d2-1428-4477-ba43-f4a0ba12850d"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:43.092462 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:32:43.092462 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:32:43.092972 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-8c6af6a2-4d35-4edd-ab55-4ff07625392e tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/87852894-21ea-4345-ace1-3a0724e544e9" status: 200 len: 1314 microversion: 2.1 time: 0.297828 Oct 28 12:32:43.102447 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 151/312] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:42 2021] GET /compute/v2.1/servers/87852894-21ea-4345-ace1-3a0724e544e9 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:43.102651 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-8e68b8d6-8a18-45bc-962b-236b97180846 req-ae0f09c9-fd6f-499b-ab04-df44ce8b2946 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:43.102651 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-8e68b8d6-8a18-45bc-962b-236b97180846 req-ae0f09c9-fd6f-499b-ab04-df44ce8b2946 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:43.113912 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-8e68b8d6-8a18-45bc-962b-236b97180846 req-ae0f09c9-fd6f-499b-ab04-df44ce8b2946 service nova] Creating event network-changed:31bae4d2-1428-4477-ba43-f4a0ba12850d for instance 87852894-21ea-4345-ace1-3a0724e544e9 on hv-cinder-81514 Oct 28 12:32:43.119559 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-8e68b8d6-8a18-45bc-962b-236b97180846 req-ae0f09c9-fd6f-499b-ab04-df44ce8b2946 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032075 Oct 28 12:32:43.120325 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 162/313] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:32:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:32:43.504208 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-5716315b-9d8d-4fb8-9c66-e3c3425b01cc tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:43.505940 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-5716315b-9d8d-4fb8-9c66-e3c3425b01cc tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] [instance: 2c2b85ef-76d8-4707-83a5-5a83394b80df] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:43.506471 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-b3c3f458-7e83-4fa9-b2f1-cb1e65576ed2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:43.507229 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-b3c3f458-7e83-4fa9-b2f1-cb1e65576ed2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:43.515305 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b3c3f458-7e83-4fa9-b2f1-cb1e65576ed2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:43.515543 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5716315b-9d8d-4fb8-9c66-e3c3425b01cc tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:43.516337 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5716315b-9d8d-4fb8-9c66-e3c3425b01cc tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:43.516624 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b3c3f458-7e83-4fa9-b2f1-cb1e65576ed2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:43.517436 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b3c3f458-7e83-4fa9-b2f1-cb1e65576ed2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:43.517839 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5716315b-9d8d-4fb8-9c66-e3c3425b01cc tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:43.517972 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b3c3f458-7e83-4fa9-b2f1-cb1e65576ed2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:43.518550 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5716315b-9d8d-4fb8-9c66-e3c3425b01cc tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:43.720042 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-b3c3f458-7e83-4fa9-b2f1-cb1e65576ed2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:43.729732 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-b3c3f458-7e83-4fa9-b2f1-cb1e65576ed2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:43.731711 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-b3c3f458-7e83-4fa9-b2f1-cb1e65576ed2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:43.734387 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-b3c3f458-7e83-4fa9-b2f1-cb1e65576ed2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1724 microversion: 2.20 time: 0.233806 Oct 28 12:32:43.735101 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 152/314] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:32:43 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:32:43.796447 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-1c2e7483-ab0b-4473-8449-ef8b9ba99ff4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:43.797718 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-1c2e7483-ab0b-4473-8449-ef8b9ba99ff4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:43.810954 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1c2e7483-ab0b-4473-8449-ef8b9ba99ff4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:43.812122 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1c2e7483-ab0b-4473-8449-ef8b9ba99ff4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:43.814077 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1c2e7483-ab0b-4473-8449-ef8b9ba99ff4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:43.815605 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1c2e7483-ab0b-4473-8449-ef8b9ba99ff4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:43.825547 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-5716315b-9d8d-4fb8-9c66-e3c3425b01cc tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c0f7f787ad4496809a5015b221cb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0885f209fd8c4c39a508059798fec9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:43.841765 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-5716315b-9d8d-4fb8-9c66-e3c3425b01cc tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] 10.222.0.62 "GET /compute/v2.1/servers/2c2b85ef-76d8-4707-83a5-5a83394b80df" status: 200 len: 1469 microversion: 2.1 time: 0.341193 Oct 28 12:32:43.844165 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 163/315] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:43 2021] GET /compute/v2.1/servers/2c2b85ef-76d8-4707-83a5-5a83394b80df => generated 1469 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:43.853883 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-73212944-0c65-4f37-b78c-202601e4cb23 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:43.869570 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-73212944-0c65-4f37-b78c-202601e4cb23 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:43.870717 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-73212944-0c65-4f37-b78c-202601e4cb23 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:44.031572 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-73212944-0c65-4f37-b78c-202601e4cb23 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Going to try to stop instance {{(pid=115877) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Oct 28 12:32:44.111396 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-73212944-0c65-4f37-b78c-202601e4cb23 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 202 len: 0 microversion: 2.1 time: 0.265170 Oct 28 12:32:44.113302 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 164/316] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:32:43 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:32:44.122246 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-efae5139-76ec-466d-89f2-a87fb4c6aa7c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:44.123296 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-efae5139-76ec-466d-89f2-a87fb4c6aa7c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a02b0570-d3b8-4fe1-aa09-199f6525ac0c] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:44.131553 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-efae5139-76ec-466d-89f2-a87fb4c6aa7c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:44.132295 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-efae5139-76ec-466d-89f2-a87fb4c6aa7c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:44.133358 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-efae5139-76ec-466d-89f2-a87fb4c6aa7c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:44.134034 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-efae5139-76ec-466d-89f2-a87fb4c6aa7c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:44.165766 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-1c2e7483-ab0b-4473-8449-ef8b9ba99ff4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:44.179044 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-1c2e7483-ab0b-4473-8449-ef8b9ba99ff4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1566 microversion: 2.1 time: 0.390376 Oct 28 12:32:44.180540 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 153/317] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:43 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1566 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:44.187207 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-ea2fdc95-e1db-4dd0-a128-7d921aaf8d15 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:44.188158 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-ea2fdc95-e1db-4dd0-a128-7d921aaf8d15 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 87852894-21ea-4345-ace1-3a0724e544e9] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:44.196283 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ea2fdc95-e1db-4dd0-a128-7d921aaf8d15 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:44.197170 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ea2fdc95-e1db-4dd0-a128-7d921aaf8d15 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:44.201106 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ea2fdc95-e1db-4dd0-a128-7d921aaf8d15 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:44.201937 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ea2fdc95-e1db-4dd0-a128-7d921aaf8d15 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:44.447032 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-efae5139-76ec-466d-89f2-a87fb4c6aa7c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:44.457836 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-efae5139-76ec-466d-89f2-a87fb4c6aa7c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c" status: 200 len: 1267 microversion: 2.1 time: 0.343227 Oct 28 12:32:44.458642 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 165/318] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:44 2021] GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c => generated 1267 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:44.463374 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-1b0c0b5d-202f-4423-995c-c4b4654baff1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:44.464163 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-1b0c0b5d-202f-4423-995c-c4b4654baff1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:44.470962 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1b0c0b5d-202f-4423-995c-c4b4654baff1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:44.472910 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1b0c0b5d-202f-4423-995c-c4b4654baff1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:44.474192 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1b0c0b5d-202f-4423-995c-c4b4654baff1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:44.474804 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1b0c0b5d-202f-4423-995c-c4b4654baff1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:44.599957 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-ea2fdc95-e1db-4dd0-a128-7d921aaf8d15 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9342796ec00a4004be5d853d307a2411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbbbaba86b74b2184637e1cf58ec643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:44.608595 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-ea2fdc95-e1db-4dd0-a128-7d921aaf8d15 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/87852894-21ea-4345-ace1-3a0724e544e9" status: 200 len: 1314 microversion: 2.1 time: 0.426597 Oct 28 12:32:44.609890 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 154/319] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:44 2021] GET /compute/v2.1/servers/87852894-21ea-4345-ace1-3a0724e544e9 => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:44.726393 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-1b0c0b5d-202f-4423-995c-c4b4654baff1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:44.739719 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-1b0c0b5d-202f-4423-995c-c4b4654baff1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1721 microversion: 2.1 time: 0.279806 Oct 28 12:32:44.740566 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 166/320] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:44 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1721 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:44.753674 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-441619c5-9100-4e56-9980-7b466bb4bf3a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:44.754280 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-441619c5-9100-4e56-9980-7b466bb4bf3a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:44.761500 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-441619c5-9100-4e56-9980-7b466bb4bf3a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:44.761938 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-441619c5-9100-4e56-9980-7b466bb4bf3a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:44.762876 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-441619c5-9100-4e56-9980-7b466bb4bf3a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:44.763348 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-441619c5-9100-4e56-9980-7b466bb4bf3a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:44.872517 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-8166ec4c-827f-44c6-ae03-96801f6c5b50 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:44.873377 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-8166ec4c-827f-44c6-ae03-96801f6c5b50 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] [instance: 2c2b85ef-76d8-4707-83a5-5a83394b80df] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:44.879731 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8166ec4c-827f-44c6-ae03-96801f6c5b50 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:44.880173 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8166ec4c-827f-44c6-ae03-96801f6c5b50 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:44.881052 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8166ec4c-827f-44c6-ae03-96801f6c5b50 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:44.881487 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8166ec4c-827f-44c6-ae03-96801f6c5b50 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:44.981135 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-8166ec4c-827f-44c6-ae03-96801f6c5b50 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c0f7f787ad4496809a5015b221cb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0885f209fd8c4c39a508059798fec9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:44.996826 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-8166ec4c-827f-44c6-ae03-96801f6c5b50 tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] 10.222.0.62 "GET /compute/v2.1/servers/2c2b85ef-76d8-4707-83a5-5a83394b80df" status: 200 len: 1427 microversion: 2.1 time: 0.126890 Oct 28 12:32:44.997662 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 167/321] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:44 2021] GET /compute/v2.1/servers/2c2b85ef-76d8-4707-83a5-5a83394b80df => generated 1427 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:32:45.004237 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-8799be63-d78a-42fb-8d07-907ca1e15d88 req-ae4ba60f-3379-4784-a3c2-5fe1b5bc18e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2b85ef-76d8-4707-83a5-5a83394b80df", "name": "network-vif-deleted", "tag": "7c81d3d4-a1e4-4e95-b3ef-ec5660cf0f30"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:45.007448 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:32:45.007448 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:32:45.019315 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-8799be63-d78a-42fb-8d07-907ca1e15d88 req-ae4ba60f-3379-4784-a3c2-5fe1b5bc18e0 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:45.020132 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-8799be63-d78a-42fb-8d07-907ca1e15d88 req-ae4ba60f-3379-4784-a3c2-5fe1b5bc18e0 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:45.032983 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-441619c5-9100-4e56-9980-7b466bb4bf3a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:45.035726 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-8799be63-d78a-42fb-8d07-907ca1e15d88 req-ae4ba60f-3379-4784-a3c2-5fe1b5bc18e0 service nova] Creating event network-vif-deleted:7c81d3d4-a1e4-4e95-b3ef-ec5660cf0f30 for instance 2c2b85ef-76d8-4707-83a5-5a83394b80df on hv-cinder-81514 Oct 28 12:32:45.041316 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-8799be63-d78a-42fb-8d07-907ca1e15d88 req-ae4ba60f-3379-4784-a3c2-5fe1b5bc18e0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041992 Oct 28 12:32:45.042279 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 168/322] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:32:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:32:45.045578 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-441619c5-9100-4e56-9980-7b466bb4bf3a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:45.047563 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-441619c5-9100-4e56-9980-7b466bb4bf3a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:45.049209 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-441619c5-9100-4e56-9980-7b466bb4bf3a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1724 microversion: 2.20 time: 0.299355 Oct 28 12:32:45.049792 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 155/323] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:32:44 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1724 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:32:45.198471 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-dad5b302-31c0-4314-b5c6-a4bb69e76b28 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:45.199187 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-dad5b302-31c0-4314-b5c6-a4bb69e76b28 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:45.205708 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-dad5b302-31c0-4314-b5c6-a4bb69e76b28 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:45.206138 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-dad5b302-31c0-4314-b5c6-a4bb69e76b28 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:45.206860 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-dad5b302-31c0-4314-b5c6-a4bb69e76b28 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:45.207281 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-dad5b302-31c0-4314-b5c6-a4bb69e76b28 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:45.352697 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-dad5b302-31c0-4314-b5c6-a4bb69e76b28 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:45.361024 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-dad5b302-31c0-4314-b5c6-a4bb69e76b28 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1566 microversion: 2.1 time: 0.166931 Oct 28 12:32:45.361819 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 169/324] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:45 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:32:45.477914 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-43f3c7ea-4cda-47ac-8b69-8250a92a7d1a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:45.478793 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-43f3c7ea-4cda-47ac-8b69-8250a92a7d1a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a02b0570-d3b8-4fe1-aa09-199f6525ac0c] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:45.486790 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-43f3c7ea-4cda-47ac-8b69-8250a92a7d1a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:45.487461 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-43f3c7ea-4cda-47ac-8b69-8250a92a7d1a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:45.488332 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-43f3c7ea-4cda-47ac-8b69-8250a92a7d1a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:45.489019 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-43f3c7ea-4cda-47ac-8b69-8250a92a7d1a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:45.624003 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-43f3c7ea-4cda-47ac-8b69-8250a92a7d1a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:45.625265 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-34b38af7-3d9d-415f-a647-6206b2554594 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:45.625840 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-34b38af7-3d9d-415f-a647-6206b2554594 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 87852894-21ea-4345-ace1-3a0724e544e9] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:45.632254 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-34b38af7-3d9d-415f-a647-6206b2554594 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:45.632703 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-34b38af7-3d9d-415f-a647-6206b2554594 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:45.633508 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-34b38af7-3d9d-415f-a647-6206b2554594 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:45.633939 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-34b38af7-3d9d-415f-a647-6206b2554594 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:45.635182 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-43f3c7ea-4cda-47ac-8b69-8250a92a7d1a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c" status: 200 len: 1267 microversion: 2.1 time: 0.162243 Oct 28 12:32:45.636260 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 156/325] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:45 2021] GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:45.759476 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-d1aa2701-7e3b-4a72-aafc-32d8784761fc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:45.760114 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-d1aa2701-7e3b-4a72-aafc-32d8784761fc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:45.761058 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-34b38af7-3d9d-415f-a647-6206b2554594 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9342796ec00a4004be5d853d307a2411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbbbaba86b74b2184637e1cf58ec643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:45.767403 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d1aa2701-7e3b-4a72-aafc-32d8784761fc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:45.767846 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d1aa2701-7e3b-4a72-aafc-32d8784761fc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:45.768629 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d1aa2701-7e3b-4a72-aafc-32d8784761fc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:45.768899 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-34b38af7-3d9d-415f-a647-6206b2554594 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/87852894-21ea-4345-ace1-3a0724e544e9" status: 200 len: 1314 microversion: 2.1 time: 0.147418 Oct 28 12:32:45.769124 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d1aa2701-7e3b-4a72-aafc-32d8784761fc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:45.769460 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 170/326] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:45 2021] GET /compute/v2.1/servers/87852894-21ea-4345-ace1-3a0724e544e9 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:45.914086 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-d1aa2701-7e3b-4a72-aafc-32d8784761fc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:45.922549 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-d1aa2701-7e3b-4a72-aafc-32d8784761fc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1721 microversion: 2.1 time: 0.166839 Oct 28 12:32:45.923111 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 157/327] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:45 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:32:46.014068 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-1d423a44-a3da-4dfa-aca4-4d609389999f tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:46.014806 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-1d423a44-a3da-4dfa-aca4-4d609389999f tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] [instance: 2c2b85ef-76d8-4707-83a5-5a83394b80df] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:46.021738 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1d423a44-a3da-4dfa-aca4-4d609389999f tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:46.022202 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1d423a44-a3da-4dfa-aca4-4d609389999f tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:46.023041 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1d423a44-a3da-4dfa-aca4-4d609389999f tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:46.023524 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1d423a44-a3da-4dfa-aca4-4d609389999f tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:46.039764 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.wsgi [None req-1d423a44-a3da-4dfa-aca4-4d609389999f tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] HTTP exception thrown: Instance 2c2b85ef-76d8-4707-83a5-5a83394b80df could not be found. Oct 28 12:32:46.040331 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-1d423a44-a3da-4dfa-aca4-4d609389999f tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] Returning 404 to user: Instance 2c2b85ef-76d8-4707-83a5-5a83394b80df could not be found. {{(pid=115877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:32:46.041297 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-1d423a44-a3da-4dfa-aca4-4d609389999f tempest-VolumesNegativeTest-447296815 tempest-VolumesNegativeTest-447296815-project] 10.222.0.62 "GET /compute/v2.1/servers/2c2b85ef-76d8-4707-83a5-5a83394b80df" status: 404 len: 111 microversion: 2.1 time: 0.031471 Oct 28 12:32:46.041847 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 171/328] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:46 2021] GET /compute/v2.1/servers/2c2b85ef-76d8-4707-83a5-5a83394b80df => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:32:46.068760 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-bee78437-041f-41ae-bbe0-06b6897088d6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:46.069395 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-bee78437-041f-41ae-bbe0-06b6897088d6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:46.075770 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-bee78437-041f-41ae-bbe0-06b6897088d6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:46.076191 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-bee78437-041f-41ae-bbe0-06b6897088d6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:46.077197 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-bee78437-041f-41ae-bbe0-06b6897088d6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:46.077619 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-bee78437-041f-41ae-bbe0-06b6897088d6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:46.217791 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-bee78437-041f-41ae-bbe0-06b6897088d6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:46.226044 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-bee78437-041f-41ae-bbe0-06b6897088d6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:46.227535 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-bee78437-041f-41ae-bbe0-06b6897088d6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:46.228695 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-bee78437-041f-41ae-bbe0-06b6897088d6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1724 microversion: 2.20 time: 0.163735 Oct 28 12:32:46.229555 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 158/329] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:32:46 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:32:46.378617 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-6fe8bf53-4bb2-40b4-961a-a2be3327743c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:46.379222 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-6fe8bf53-4bb2-40b4-961a-a2be3327743c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:46.385167 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6fe8bf53-4bb2-40b4-961a-a2be3327743c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:46.385610 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6fe8bf53-4bb2-40b4-961a-a2be3327743c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:46.387837 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6fe8bf53-4bb2-40b4-961a-a2be3327743c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:46.388859 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6fe8bf53-4bb2-40b4-961a-a2be3327743c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:46.533685 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-6fe8bf53-4bb2-40b4-961a-a2be3327743c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:46.541740 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-6fe8bf53-4bb2-40b4-961a-a2be3327743c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1566 microversion: 2.1 time: 0.166733 Oct 28 12:32:46.542233 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 172/330] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:46 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:46.655580 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-451f9212-7ae6-4d9c-aa30-b1a5a3088f68 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:46.656511 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-451f9212-7ae6-4d9c-aa30-b1a5a3088f68 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a02b0570-d3b8-4fe1-aa09-199f6525ac0c] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:46.664158 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-451f9212-7ae6-4d9c-aa30-b1a5a3088f68 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:46.664962 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-451f9212-7ae6-4d9c-aa30-b1a5a3088f68 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:46.665981 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-451f9212-7ae6-4d9c-aa30-b1a5a3088f68 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:46.668535 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-451f9212-7ae6-4d9c-aa30-b1a5a3088f68 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:46.785812 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-d2f92eda-7703-44a2-a541-6db7428f20d7 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:46.786412 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-d2f92eda-7703-44a2-a541-6db7428f20d7 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 87852894-21ea-4345-ace1-3a0724e544e9] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:46.793333 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d2f92eda-7703-44a2-a541-6db7428f20d7 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:46.793780 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d2f92eda-7703-44a2-a541-6db7428f20d7 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:46.795041 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d2f92eda-7703-44a2-a541-6db7428f20d7 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:46.795292 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d2f92eda-7703-44a2-a541-6db7428f20d7 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:46.809958 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-451f9212-7ae6-4d9c-aa30-b1a5a3088f68 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:46.820004 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-451f9212-7ae6-4d9c-aa30-b1a5a3088f68 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c" status: 200 len: 1267 microversion: 2.1 time: 0.168104 Oct 28 12:32:46.820414 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 159/331] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:46 2021] GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:46.931786 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-d2f92eda-7703-44a2-a541-6db7428f20d7 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9342796ec00a4004be5d853d307a2411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbbbaba86b74b2184637e1cf58ec643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:46.939805 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-a426b748-4747-43c7-a60d-cfab5063e46d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:46.939935 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-d2f92eda-7703-44a2-a541-6db7428f20d7 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/87852894-21ea-4345-ace1-3a0724e544e9" status: 200 len: 1314 microversion: 2.1 time: 0.157889 Oct 28 12:32:46.941269 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 173/332] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:46 2021] GET /compute/v2.1/servers/87852894-21ea-4345-ace1-3a0724e544e9 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:32:46.945632 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-a426b748-4747-43c7-a60d-cfab5063e46d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:46.953246 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a426b748-4747-43c7-a60d-cfab5063e46d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:46.953694 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a426b748-4747-43c7-a60d-cfab5063e46d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:46.954471 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a426b748-4747-43c7-a60d-cfab5063e46d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:46.955182 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a426b748-4747-43c7-a60d-cfab5063e46d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:47.103126 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-a426b748-4747-43c7-a60d-cfab5063e46d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:47.113906 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-a426b748-4747-43c7-a60d-cfab5063e46d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1721 microversion: 2.1 time: 0.177826 Oct 28 12:32:47.114513 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 160/333] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:46 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:47.246484 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-1cce3f79-3bba-4b36-9b63-7a59a7d40097 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:47.247089 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-1cce3f79-3bba-4b36-9b63-7a59a7d40097 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:47.254101 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1cce3f79-3bba-4b36-9b63-7a59a7d40097 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:47.254707 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1cce3f79-3bba-4b36-9b63-7a59a7d40097 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:47.255725 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1cce3f79-3bba-4b36-9b63-7a59a7d40097 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:47.256094 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1cce3f79-3bba-4b36-9b63-7a59a7d40097 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:47.407142 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-1cce3f79-3bba-4b36-9b63-7a59a7d40097 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:47.416036 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-1cce3f79-3bba-4b36-9b63-7a59a7d40097 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:47.417679 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-1cce3f79-3bba-4b36-9b63-7a59a7d40097 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:47.420161 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-1cce3f79-3bba-4b36-9b63-7a59a7d40097 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1724 microversion: 2.20 time: 0.177377 Oct 28 12:32:47.420794 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 174/334] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:32:47 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:32:47.559856 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-076e883d-aba6-40c0-8d16-f4336b855450 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:47.560636 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-076e883d-aba6-40c0-8d16-f4336b855450 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:47.567624 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-076e883d-aba6-40c0-8d16-f4336b855450 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:47.568584 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-076e883d-aba6-40c0-8d16-f4336b855450 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:47.569580 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-076e883d-aba6-40c0-8d16-f4336b855450 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:47.570581 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-076e883d-aba6-40c0-8d16-f4336b855450 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:47.710190 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-076e883d-aba6-40c0-8d16-f4336b855450 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:47.721684 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-076e883d-aba6-40c0-8d16-f4336b855450 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1566 microversion: 2.1 time: 0.166055 Oct 28 12:32:47.722250 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 161/335] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:47 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:32:47.837135 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-ba7070e1-f4bf-4002-bc85-298d2cf68448 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:47.837891 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-ba7070e1-f4bf-4002-bc85-298d2cf68448 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a02b0570-d3b8-4fe1-aa09-199f6525ac0c] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:47.844631 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ba7070e1-f4bf-4002-bc85-298d2cf68448 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:47.845133 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ba7070e1-f4bf-4002-bc85-298d2cf68448 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:47.846107 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ba7070e1-f4bf-4002-bc85-298d2cf68448 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:47.846536 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ba7070e1-f4bf-4002-bc85-298d2cf68448 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:47.957072 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-1e9cdca5-5f96-4ad9-b40a-38b53dd548d9 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:47.957675 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-1e9cdca5-5f96-4ad9-b40a-38b53dd548d9 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 87852894-21ea-4345-ace1-3a0724e544e9] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:47.964279 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1e9cdca5-5f96-4ad9-b40a-38b53dd548d9 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:47.964860 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1e9cdca5-5f96-4ad9-b40a-38b53dd548d9 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:47.965877 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1e9cdca5-5f96-4ad9-b40a-38b53dd548d9 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:47.966495 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1e9cdca5-5f96-4ad9-b40a-38b53dd548d9 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:47.993842 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-ba7070e1-f4bf-4002-bc85-298d2cf68448 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:48.008910 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-ba7070e1-f4bf-4002-bc85-298d2cf68448 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c" status: 200 len: 1267 microversion: 2.1 time: 0.170398 Oct 28 12:32:48.008910 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 175/336] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:47 2021] GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:48.105228 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-1e9cdca5-5f96-4ad9-b40a-38b53dd548d9 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9342796ec00a4004be5d853d307a2411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbbbaba86b74b2184637e1cf58ec643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:48.113083 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-1e9cdca5-5f96-4ad9-b40a-38b53dd548d9 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/87852894-21ea-4345-ace1-3a0724e544e9" status: 200 len: 1314 microversion: 2.1 time: 0.159655 Oct 28 12:32:48.113778 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 162/337] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:47 2021] GET /compute/v2.1/servers/87852894-21ea-4345-ace1-3a0724e544e9 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:48.132918 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-2b9d3f04-b8e4-4b42-9e0d-af9cd1e8c69c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:48.133554 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-2b9d3f04-b8e4-4b42-9e0d-af9cd1e8c69c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:48.140369 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2b9d3f04-b8e4-4b42-9e0d-af9cd1e8c69c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:48.141189 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2b9d3f04-b8e4-4b42-9e0d-af9cd1e8c69c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:48.142083 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2b9d3f04-b8e4-4b42-9e0d-af9cd1e8c69c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:48.142507 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2b9d3f04-b8e4-4b42-9e0d-af9cd1e8c69c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:48.280179 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-2b9d3f04-b8e4-4b42-9e0d-af9cd1e8c69c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:48.288644 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-2b9d3f04-b8e4-4b42-9e0d-af9cd1e8c69c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1721 microversion: 2.1 time: 0.159997 Oct 28 12:32:48.289276 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 176/338] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:48 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:48.439342 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-e78297e8-b97f-4d72-a5a8-81a83c240e7e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:48.439957 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-e78297e8-b97f-4d72-a5a8-81a83c240e7e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:48.446868 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e78297e8-b97f-4d72-a5a8-81a83c240e7e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:48.447559 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e78297e8-b97f-4d72-a5a8-81a83c240e7e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:48.448590 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e78297e8-b97f-4d72-a5a8-81a83c240e7e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:48.449065 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e78297e8-b97f-4d72-a5a8-81a83c240e7e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:48.595634 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-e78297e8-b97f-4d72-a5a8-81a83c240e7e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:48.612602 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-e78297e8-b97f-4d72-a5a8-81a83c240e7e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:48.612602 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-e78297e8-b97f-4d72-a5a8-81a83c240e7e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:48.612602 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-e78297e8-b97f-4d72-a5a8-81a83c240e7e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1724 microversion: 2.20 time: 0.171902 Oct 28 12:32:48.613199 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 163/339] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:32:48 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:32:48.778261 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-2a537a9e-f466-450e-9204-8f63374d6941 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:48.779145 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-2a537a9e-f466-450e-9204-8f63374d6941 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:48.785879 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2a537a9e-f466-450e-9204-8f63374d6941 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:48.786317 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2a537a9e-f466-450e-9204-8f63374d6941 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:48.787114 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2a537a9e-f466-450e-9204-8f63374d6941 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:48.787529 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2a537a9e-f466-450e-9204-8f63374d6941 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:48.918777 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-2a537a9e-f466-450e-9204-8f63374d6941 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:48.926950 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-2a537a9e-f466-450e-9204-8f63374d6941 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1566 microversion: 2.1 time: 0.152693 Oct 28 12:32:48.927523 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 177/340] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:48 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:49.021430 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-9dd6361e-c7e2-4830-9272-ad3df3d3f43f tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:49.022064 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-9dd6361e-c7e2-4830-9272-ad3df3d3f43f tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a02b0570-d3b8-4fe1-aa09-199f6525ac0c] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:49.028641 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9dd6361e-c7e2-4830-9272-ad3df3d3f43f tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:49.029125 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9dd6361e-c7e2-4830-9272-ad3df3d3f43f tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:49.029919 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9dd6361e-c7e2-4830-9272-ad3df3d3f43f tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:49.030457 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9dd6361e-c7e2-4830-9272-ad3df3d3f43f tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:49.132365 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-d24e28f0-0e1d-4fa1-9ac1-d52606f16eb1 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:49.133416 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-d24e28f0-0e1d-4fa1-9ac1-d52606f16eb1 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 87852894-21ea-4345-ace1-3a0724e544e9] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:49.140260 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d24e28f0-0e1d-4fa1-9ac1-d52606f16eb1 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:49.140979 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d24e28f0-0e1d-4fa1-9ac1-d52606f16eb1 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:49.142014 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d24e28f0-0e1d-4fa1-9ac1-d52606f16eb1 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:49.142819 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d24e28f0-0e1d-4fa1-9ac1-d52606f16eb1 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:49.178735 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-9dd6361e-c7e2-4830-9272-ad3df3d3f43f tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:49.188797 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-9dd6361e-c7e2-4830-9272-ad3df3d3f43f tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c" status: 200 len: 1267 microversion: 2.1 time: 0.170996 Oct 28 12:32:49.189601 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 164/341] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:49 2021] GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:49.205896 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-2b6bc9ad-f1a7-42bb-ac35-c87b3e3ceb99 req-50a95f82-9ee6-4c9f-a73d-2d28394b57df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87852894-21ea-4345-ace1-3a0724e544e9", "name": "network-vif-plugged", "status": "completed", "tag": "31bae4d2-1428-4477-ba43-f4a0ba12850d"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:49.209541 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:32:49.209541 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:32:49.217271 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-2b6bc9ad-f1a7-42bb-ac35-c87b3e3ceb99 req-50a95f82-9ee6-4c9f-a73d-2d28394b57df service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:49.217873 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-2b6bc9ad-f1a7-42bb-ac35-c87b3e3ceb99 req-50a95f82-9ee6-4c9f-a73d-2d28394b57df service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:49.232699 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-2b6bc9ad-f1a7-42bb-ac35-c87b3e3ceb99 req-50a95f82-9ee6-4c9f-a73d-2d28394b57df service nova] Creating event network-vif-plugged:31bae4d2-1428-4477-ba43-f4a0ba12850d for instance 87852894-21ea-4345-ace1-3a0724e544e9 on hv-cinder-81514 Oct 28 12:32:49.238351 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-2b6bc9ad-f1a7-42bb-ac35-c87b3e3ceb99 req-50a95f82-9ee6-4c9f-a73d-2d28394b57df service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038589 Oct 28 12:32:49.241789 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 165/342] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:32:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:32:49.298189 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-d24e28f0-0e1d-4fa1-9ac1-d52606f16eb1 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9342796ec00a4004be5d853d307a2411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbbbaba86b74b2184637e1cf58ec643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:49.306442 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-73c72812-f5f7-47e9-aac9-c5b1b95d2f49 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:49.307331 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-73c72812-f5f7-47e9-aac9-c5b1b95d2f49 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:49.308834 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-d24e28f0-0e1d-4fa1-9ac1-d52606f16eb1 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/87852894-21ea-4345-ace1-3a0724e544e9" status: 200 len: 1314 microversion: 2.1 time: 0.180768 Oct 28 12:32:49.315158 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-73c72812-f5f7-47e9-aac9-c5b1b95d2f49 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:49.315677 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-73c72812-f5f7-47e9-aac9-c5b1b95d2f49 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:49.316440 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-73c72812-f5f7-47e9-aac9-c5b1b95d2f49 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:49.316893 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-73c72812-f5f7-47e9-aac9-c5b1b95d2f49 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:49.318902 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 178/343] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:49 2021] GET /compute/v2.1/servers/87852894-21ea-4345-ace1-3a0724e544e9 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:32:49.476308 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-73c72812-f5f7-47e9-aac9-c5b1b95d2f49 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:49.485120 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-73c72812-f5f7-47e9-aac9-c5b1b95d2f49 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1721 microversion: 2.1 time: 0.182550 Oct 28 12:32:49.485725 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 166/344] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:49 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:32:49.633587 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-df8d19e9-d43c-4178-9d14-040362f70b1e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:49.634279 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-df8d19e9-d43c-4178-9d14-040362f70b1e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:49.641235 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-df8d19e9-d43c-4178-9d14-040362f70b1e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:49.641647 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-df8d19e9-d43c-4178-9d14-040362f70b1e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:49.642431 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-df8d19e9-d43c-4178-9d14-040362f70b1e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:49.642884 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-df8d19e9-d43c-4178-9d14-040362f70b1e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:49.773217 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-df8d19e9-d43c-4178-9d14-040362f70b1e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:49.781394 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-df8d19e9-d43c-4178-9d14-040362f70b1e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:49.782865 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-df8d19e9-d43c-4178-9d14-040362f70b1e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:49.784022 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-df8d19e9-d43c-4178-9d14-040362f70b1e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1724 microversion: 2.20 time: 0.154179 Oct 28 12:32:49.784557 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 179/345] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:32:49 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:32:49.947548 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-b8e02434-db49-4000-8063-7add5c552d75 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:49.948242 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-b8e02434-db49-4000-8063-7add5c552d75 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:49.955261 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b8e02434-db49-4000-8063-7add5c552d75 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:49.955906 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b8e02434-db49-4000-8063-7add5c552d75 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:49.956785 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b8e02434-db49-4000-8063-7add5c552d75 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:49.957282 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b8e02434-db49-4000-8063-7add5c552d75 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:50.097902 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-b8e02434-db49-4000-8063-7add5c552d75 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:50.105990 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-b8e02434-db49-4000-8063-7add5c552d75 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1566 microversion: 2.1 time: 0.162213 Oct 28 12:32:50.106629 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 167/346] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:49 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:50.206207 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-1f872fbd-5099-407f-af98-806a60bb14c3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:50.206835 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-1f872fbd-5099-407f-af98-806a60bb14c3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a02b0570-d3b8-4fe1-aa09-199f6525ac0c] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:50.214125 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1f872fbd-5099-407f-af98-806a60bb14c3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:50.214573 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1f872fbd-5099-407f-af98-806a60bb14c3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:50.215350 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1f872fbd-5099-407f-af98-806a60bb14c3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:50.215827 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1f872fbd-5099-407f-af98-806a60bb14c3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:50.327167 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-98f2e7c1-94a1-4599-8038-9e1f2adf5dfe tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:50.327778 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-98f2e7c1-94a1-4599-8038-9e1f2adf5dfe tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 87852894-21ea-4345-ace1-3a0724e544e9] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:50.334488 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-98f2e7c1-94a1-4599-8038-9e1f2adf5dfe tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:50.335376 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-98f2e7c1-94a1-4599-8038-9e1f2adf5dfe tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:50.340986 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-98f2e7c1-94a1-4599-8038-9e1f2adf5dfe tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:50.341648 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-98f2e7c1-94a1-4599-8038-9e1f2adf5dfe tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:50.346990 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-1f872fbd-5099-407f-af98-806a60bb14c3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:50.356099 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-1f872fbd-5099-407f-af98-806a60bb14c3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c" status: 200 len: 1267 microversion: 2.1 time: 0.153541 Oct 28 12:32:50.356792 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 180/347] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:50 2021] GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:50.492491 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-98f2e7c1-94a1-4599-8038-9e1f2adf5dfe tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9342796ec00a4004be5d853d307a2411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbbbaba86b74b2184637e1cf58ec643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:50.500898 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-98f2e7c1-94a1-4599-8038-9e1f2adf5dfe tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/87852894-21ea-4345-ace1-3a0724e544e9" status: 200 len: 1314 microversion: 2.1 time: 0.178164 Oct 28 12:32:50.501655 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 168/348] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:50 2021] GET /compute/v2.1/servers/87852894-21ea-4345-ace1-3a0724e544e9 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:50.502486 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-56928bc5-aa31-440d-9f32-efd8d165e438 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:50.503097 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-56928bc5-aa31-440d-9f32-efd8d165e438 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:50.508986 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-56928bc5-aa31-440d-9f32-efd8d165e438 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:50.509434 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-56928bc5-aa31-440d-9f32-efd8d165e438 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:50.510209 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-56928bc5-aa31-440d-9f32-efd8d165e438 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:50.510645 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-56928bc5-aa31-440d-9f32-efd8d165e438 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:50.650993 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-56928bc5-aa31-440d-9f32-efd8d165e438 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:50.660931 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-56928bc5-aa31-440d-9f32-efd8d165e438 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1721 microversion: 2.1 time: 0.162100 Oct 28 12:32:50.661563 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 181/349] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:50 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:50.802542 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-4f97f774-84d2-4d27-b269-6cd8ee6be912 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:50.803049 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-4f97f774-84d2-4d27-b269-6cd8ee6be912 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:50.810074 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4f97f774-84d2-4d27-b269-6cd8ee6be912 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:50.810572 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4f97f774-84d2-4d27-b269-6cd8ee6be912 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:50.811321 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4f97f774-84d2-4d27-b269-6cd8ee6be912 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:50.811980 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4f97f774-84d2-4d27-b269-6cd8ee6be912 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:50.950122 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-4f97f774-84d2-4d27-b269-6cd8ee6be912 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:50.959486 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-4f97f774-84d2-4d27-b269-6cd8ee6be912 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:50.961792 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-4f97f774-84d2-4d27-b269-6cd8ee6be912 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:50.963138 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-4f97f774-84d2-4d27-b269-6cd8ee6be912 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1724 microversion: 2.20 time: 0.164695 Oct 28 12:32:50.964127 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 169/350] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:32:50 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:32:51.125243 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-316c12f6-646a-4c15-a749-4410e3c4fb67 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:51.125904 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-316c12f6-646a-4c15-a749-4410e3c4fb67 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:51.133451 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-316c12f6-646a-4c15-a749-4410e3c4fb67 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:51.133901 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-316c12f6-646a-4c15-a749-4410e3c4fb67 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:51.134903 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-316c12f6-646a-4c15-a749-4410e3c4fb67 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:51.135501 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-316c12f6-646a-4c15-a749-4410e3c4fb67 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:51.277154 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-316c12f6-646a-4c15-a749-4410e3c4fb67 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:51.285606 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-316c12f6-646a-4c15-a749-4410e3c4fb67 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1566 microversion: 2.1 time: 0.165829 Oct 28 12:32:51.286232 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 182/351] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:51 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:32:51.379088 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-567c1cad-be78-4a88-97db-47bc6a672e90 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:51.379628 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-567c1cad-be78-4a88-97db-47bc6a672e90 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a02b0570-d3b8-4fe1-aa09-199f6525ac0c] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:51.386471 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-567c1cad-be78-4a88-97db-47bc6a672e90 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:51.386914 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-567c1cad-be78-4a88-97db-47bc6a672e90 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:51.387744 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-567c1cad-be78-4a88-97db-47bc6a672e90 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:51.390784 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-567c1cad-be78-4a88-97db-47bc6a672e90 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:51.518414 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-41f01931-1183-4c70-99f1-c942bb4d08a4 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:51.519130 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-41f01931-1183-4c70-99f1-c942bb4d08a4 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 87852894-21ea-4345-ace1-3a0724e544e9] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:51.526856 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-41f01931-1183-4c70-99f1-c942bb4d08a4 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:51.527430 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-41f01931-1183-4c70-99f1-c942bb4d08a4 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:51.528243 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-41f01931-1183-4c70-99f1-c942bb4d08a4 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:51.528665 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-41f01931-1183-4c70-99f1-c942bb4d08a4 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:51.810372 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-567c1cad-be78-4a88-97db-47bc6a672e90 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:51.817420 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-41f01931-1183-4c70-99f1-c942bb4d08a4 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9342796ec00a4004be5d853d307a2411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbbbaba86b74b2184637e1cf58ec643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:51.818635 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-567c1cad-be78-4a88-97db-47bc6a672e90 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c" status: 200 len: 1267 microversion: 2.1 time: 0.443654 Oct 28 12:32:51.819310 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 170/352] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:51 2021] GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c => generated 1267 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:51.823761 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-d0f8148e-6c7f-4ca7-a9ed-9f9f3eb63d38 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:51.824348 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-d0f8148e-6c7f-4ca7-a9ed-9f9f3eb63d38 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:51.825888 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-41f01931-1183-4c70-99f1-c942bb4d08a4 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/87852894-21ea-4345-ace1-3a0724e544e9" status: 200 len: 1498 microversion: 2.1 time: 0.311342 Oct 28 12:32:51.826491 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 183/353] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:51 2021] GET /compute/v2.1/servers/87852894-21ea-4345-ace1-3a0724e544e9 => generated 1498 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:32:51.830286 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d0f8148e-6c7f-4ca7-a9ed-9f9f3eb63d38 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:51.830722 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d0f8148e-6c7f-4ca7-a9ed-9f9f3eb63d38 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:51.831488 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d0f8148e-6c7f-4ca7-a9ed-9f9f3eb63d38 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:51.831910 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d0f8148e-6c7f-4ca7-a9ed-9f9f3eb63d38 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:51.967241 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-d0f8148e-6c7f-4ca7-a9ed-9f9f3eb63d38 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:51.976182 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-d0f8148e-6c7f-4ca7-a9ed-9f9f3eb63d38 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1721 microversion: 2.1 time: 0.155926 Oct 28 12:32:51.976890 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 171/354] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:51 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:51.985568 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-3dd8cd46-3b96-4975-b685-49dbf03f20a1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:51.986318 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-3dd8cd46-3b96-4975-b685-49dbf03f20a1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:51.992998 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3dd8cd46-3b96-4975-b685-49dbf03f20a1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:51.993481 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3dd8cd46-3b96-4975-b685-49dbf03f20a1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:51.994252 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3dd8cd46-3b96-4975-b685-49dbf03f20a1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:51.994680 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3dd8cd46-3b96-4975-b685-49dbf03f20a1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:52.137603 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-3dd8cd46-3b96-4975-b685-49dbf03f20a1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:52.148856 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-3dd8cd46-3b96-4975-b685-49dbf03f20a1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:52.151789 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-3dd8cd46-3b96-4975-b685-49dbf03f20a1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:52.155053 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-3dd8cd46-3b96-4975-b685-49dbf03f20a1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1724 microversion: 2.20 time: 0.174557 Oct 28 12:32:52.155889 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 184/355] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:32:51 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:32:52.303773 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-ef95f8fa-2456-4d4e-b435-a16fc3eaae86 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:52.304388 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-ef95f8fa-2456-4d4e-b435-a16fc3eaae86 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:52.310782 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ef95f8fa-2456-4d4e-b435-a16fc3eaae86 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:52.311233 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ef95f8fa-2456-4d4e-b435-a16fc3eaae86 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:52.312051 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ef95f8fa-2456-4d4e-b435-a16fc3eaae86 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:52.312483 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ef95f8fa-2456-4d4e-b435-a16fc3eaae86 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:52.378748 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-ed1d7e0f-b98c-4dae-8a4e-def28d5f6788 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:52.379500 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-ed1d7e0f-b98c-4dae-8a4e-def28d5f6788 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 87852894-21ea-4345-ace1-3a0724e544e9] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:52.388235 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ed1d7e0f-b98c-4dae-8a4e-def28d5f6788 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:52.388790 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ed1d7e0f-b98c-4dae-8a4e-def28d5f6788 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:52.389589 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ed1d7e0f-b98c-4dae-8a4e-def28d5f6788 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:52.390011 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ed1d7e0f-b98c-4dae-8a4e-def28d5f6788 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:52.415530 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-ed1d7e0f-b98c-4dae-8a4e-def28d5f6788 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 87852894-21ea-4345-ace1-3a0724e544e9] Going to try to terminate instance {{(pid=115877) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:32:52.444492 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-ef95f8fa-2456-4d4e-b435-a16fc3eaae86 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:52.455099 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-ef95f8fa-2456-4d4e-b435-a16fc3eaae86 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1566 microversion: 2.1 time: 0.155036 Oct 28 12:32:52.455541 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 172/356] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:52 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:52.507121 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-ed1d7e0f-b98c-4dae-8a4e-def28d5f6788 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "DELETE /compute/v2.1/servers/87852894-21ea-4345-ace1-3a0724e544e9" status: 204 len: 0 microversion: 2.1 time: 0.133188 Oct 28 12:32:52.507723 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 185/357] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Oct 28 12:32:52 2021] DELETE /compute/v2.1/servers/87852894-21ea-4345-ace1-3a0724e544e9 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:32:52.517605 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-adbd30c4-8e3f-4d70-83ac-5a0418937263 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:52.518218 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-adbd30c4-8e3f-4d70-83ac-5a0418937263 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 87852894-21ea-4345-ace1-3a0724e544e9] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:52.526310 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-adbd30c4-8e3f-4d70-83ac-5a0418937263 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:52.526858 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-adbd30c4-8e3f-4d70-83ac-5a0418937263 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:52.527962 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-adbd30c4-8e3f-4d70-83ac-5a0418937263 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:52.528508 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-adbd30c4-8e3f-4d70-83ac-5a0418937263 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:52.668260 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-adbd30c4-8e3f-4d70-83ac-5a0418937263 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9342796ec00a4004be5d853d307a2411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbbbaba86b74b2184637e1cf58ec643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:52.677919 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-adbd30c4-8e3f-4d70-83ac-5a0418937263 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/87852894-21ea-4345-ace1-3a0724e544e9" status: 200 len: 1504 microversion: 2.1 time: 0.165334 Oct 28 12:32:52.678594 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 173/358] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:52 2021] GET /compute/v2.1/servers/87852894-21ea-4345-ace1-3a0724e544e9 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:52.837092 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-9c211d21-730e-4624-be7e-f7e0b7f26ce2 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:52.837971 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-9c211d21-730e-4624-be7e-f7e0b7f26ce2 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a02b0570-d3b8-4fe1-aa09-199f6525ac0c] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:52.845581 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9c211d21-730e-4624-be7e-f7e0b7f26ce2 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:52.846024 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9c211d21-730e-4624-be7e-f7e0b7f26ce2 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:52.846955 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9c211d21-730e-4624-be7e-f7e0b7f26ce2 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:52.847388 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9c211d21-730e-4624-be7e-f7e0b7f26ce2 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:52.993530 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-4fc1e409-dc00-402f-95cc-aeb02343c745 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:52.994140 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-4fc1e409-dc00-402f-95cc-aeb02343c745 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:52.997174 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-9c211d21-730e-4624-be7e-f7e0b7f26ce2 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:53.001042 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4fc1e409-dc00-402f-95cc-aeb02343c745 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:53.001485 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4fc1e409-dc00-402f-95cc-aeb02343c745 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:53.002302 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4fc1e409-dc00-402f-95cc-aeb02343c745 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:53.002738 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4fc1e409-dc00-402f-95cc-aeb02343c745 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:53.006982 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-9c211d21-730e-4624-be7e-f7e0b7f26ce2 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c" status: 200 len: 1267 microversion: 2.1 time: 0.174860 Oct 28 12:32:53.007543 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 186/359] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:52 2021] GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:53.143393 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-4fc1e409-dc00-402f-95cc-aeb02343c745 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:53.156267 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-4fc1e409-dc00-402f-95cc-aeb02343c745 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1721 microversion: 2.1 time: 0.166302 Oct 28 12:32:53.164786 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 174/360] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:52 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:53.174235 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-b6829252-f962-4587-9c01-865ab5105414 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:53.174891 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-b6829252-f962-4587-9c01-865ab5105414 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:53.182359 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b6829252-f962-4587-9c01-865ab5105414 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:53.182707 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b6829252-f962-4587-9c01-865ab5105414 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:53.184015 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b6829252-f962-4587-9c01-865ab5105414 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:53.187461 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b6829252-f962-4587-9c01-865ab5105414 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:53.340133 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-b6829252-f962-4587-9c01-865ab5105414 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:53.351989 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-b6829252-f962-4587-9c01-865ab5105414 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:53.353381 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-b6829252-f962-4587-9c01-865ab5105414 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:53.357253 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-b6829252-f962-4587-9c01-865ab5105414 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1724 microversion: 2.20 time: 0.186827 Oct 28 12:32:53.358010 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 187/361] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:32:53 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:32:53.472326 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-6b4f7e25-078c-42d7-8482-24bc86039e45 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:53.472909 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-6b4f7e25-078c-42d7-8482-24bc86039e45 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:53.479566 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6b4f7e25-078c-42d7-8482-24bc86039e45 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:53.480046 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6b4f7e25-078c-42d7-8482-24bc86039e45 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:53.481023 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6b4f7e25-078c-42d7-8482-24bc86039e45 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:53.481727 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6b4f7e25-078c-42d7-8482-24bc86039e45 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:53.617192 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-6b4f7e25-078c-42d7-8482-24bc86039e45 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:53.625178 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-6b4f7e25-078c-42d7-8482-24bc86039e45 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1566 microversion: 2.1 time: 0.157097 Oct 28 12:32:53.625752 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 175/362] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:53 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:53.701401 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-057c96fb-1a1f-4e95-b75f-54080cd25bea tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:53.702393 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-057c96fb-1a1f-4e95-b75f-54080cd25bea tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 87852894-21ea-4345-ace1-3a0724e544e9] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:53.710109 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-057c96fb-1a1f-4e95-b75f-54080cd25bea tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:53.710675 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-057c96fb-1a1f-4e95-b75f-54080cd25bea tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:53.711544 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-057c96fb-1a1f-4e95-b75f-54080cd25bea tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:53.711928 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-057c96fb-1a1f-4e95-b75f-54080cd25bea tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:53.858565 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-057c96fb-1a1f-4e95-b75f-54080cd25bea tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9342796ec00a4004be5d853d307a2411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbbbaba86b74b2184637e1cf58ec643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:53.866695 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-057c96fb-1a1f-4e95-b75f-54080cd25bea tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/87852894-21ea-4345-ace1-3a0724e544e9" status: 200 len: 1504 microversion: 2.1 time: 0.171331 Oct 28 12:32:53.867417 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 188/363] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:53 2021] GET /compute/v2.1/servers/87852894-21ea-4345-ace1-3a0724e544e9 => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:54.023696 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-f8c101b0-fce5-4633-adc6-6ce43d9b2386 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:54.024313 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-f8c101b0-fce5-4633-adc6-6ce43d9b2386 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a02b0570-d3b8-4fe1-aa09-199f6525ac0c] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:54.030730 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f8c101b0-fce5-4633-adc6-6ce43d9b2386 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:54.031317 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f8c101b0-fce5-4633-adc6-6ce43d9b2386 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:54.032087 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f8c101b0-fce5-4633-adc6-6ce43d9b2386 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:54.032536 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f8c101b0-fce5-4633-adc6-6ce43d9b2386 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:54.162092 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f8c101b0-fce5-4633-adc6-6ce43d9b2386 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:54.169760 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-f8c101b0-fce5-4633-adc6-6ce43d9b2386 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c" status: 200 len: 1267 microversion: 2.1 time: 0.149969 Oct 28 12:32:54.170669 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 176/364] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:54 2021] GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:54.174413 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-94c4d8e0-fdc5-42c4-8c87-34584a757af9 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:54.175020 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-94c4d8e0-fdc5-42c4-8c87-34584a757af9 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:54.181165 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-94c4d8e0-fdc5-42c4-8c87-34584a757af9 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:54.181746 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-94c4d8e0-fdc5-42c4-8c87-34584a757af9 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:54.182534 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-94c4d8e0-fdc5-42c4-8c87-34584a757af9 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:54.182958 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-94c4d8e0-fdc5-42c4-8c87-34584a757af9 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:54.331549 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-94c4d8e0-fdc5-42c4-8c87-34584a757af9 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:54.339879 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-94c4d8e0-fdc5-42c4-8c87-34584a757af9 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1721 microversion: 2.1 time: 0.169189 Oct 28 12:32:54.340467 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 189/365] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:54 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:54.377450 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-37149817-b8ab-4bb4-8d32-743099d23ef9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:54.377965 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-37149817-b8ab-4bb4-8d32-743099d23ef9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:54.384443 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-37149817-b8ab-4bb4-8d32-743099d23ef9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:54.384889 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-37149817-b8ab-4bb4-8d32-743099d23ef9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:54.385675 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-37149817-b8ab-4bb4-8d32-743099d23ef9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:54.386155 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-37149817-b8ab-4bb4-8d32-743099d23ef9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:54.584699 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-37149817-b8ab-4bb4-8d32-743099d23ef9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:54.593167 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-37149817-b8ab-4bb4-8d32-743099d23ef9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:54.595051 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-37149817-b8ab-4bb4-8d32-743099d23ef9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:54.596474 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-37149817-b8ab-4bb4-8d32-743099d23ef9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1724 microversion: 2.20 time: 0.223364 Oct 28 12:32:54.597483 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 177/366] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:32:54 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:32:54.642945 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-c15d910b-a8aa-4fd4-959a-8eab06f8a83f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:54.643665 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-c15d910b-a8aa-4fd4-959a-8eab06f8a83f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:54.650249 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c15d910b-a8aa-4fd4-959a-8eab06f8a83f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:54.650686 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c15d910b-a8aa-4fd4-959a-8eab06f8a83f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:54.651417 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c15d910b-a8aa-4fd4-959a-8eab06f8a83f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:54.651937 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c15d910b-a8aa-4fd4-959a-8eab06f8a83f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:54.842525 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-c15d910b-a8aa-4fd4-959a-8eab06f8a83f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:54.851928 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-c15d910b-a8aa-4fd4-959a-8eab06f8a83f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1566 microversion: 2.1 time: 0.212724 Oct 28 12:32:54.852750 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 190/367] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:54 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1566 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:54.884076 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-9e4d265c-a2b8-4042-8d45-91977142a51b tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:54.884610 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-9e4d265c-a2b8-4042-8d45-91977142a51b tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 87852894-21ea-4345-ace1-3a0724e544e9] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:54.891417 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9e4d265c-a2b8-4042-8d45-91977142a51b tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:54.893420 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9e4d265c-a2b8-4042-8d45-91977142a51b tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:54.898252 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9e4d265c-a2b8-4042-8d45-91977142a51b tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:54.898699 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9e4d265c-a2b8-4042-8d45-91977142a51b tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:54.929256 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-24a772f3-c8f1-4d4b-8982-91ec0b18b300 req-1e6c1b50-a99e-462b-807f-7a3bc43efe0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87852894-21ea-4345-ace1-3a0724e544e9", "name": "network-vif-deleted", "tag": "31bae4d2-1428-4477-ba43-f4a0ba12850d"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:54.931616 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:32:54.931616 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:32:54.939969 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-24a772f3-c8f1-4d4b-8982-91ec0b18b300 req-1e6c1b50-a99e-462b-807f-7a3bc43efe0a service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:54.940927 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-24a772f3-c8f1-4d4b-8982-91ec0b18b300 req-1e6c1b50-a99e-462b-807f-7a3bc43efe0a service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:54.958912 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-24a772f3-c8f1-4d4b-8982-91ec0b18b300 req-1e6c1b50-a99e-462b-807f-7a3bc43efe0a service nova] Creating event network-vif-deleted:31bae4d2-1428-4477-ba43-f4a0ba12850d for instance 87852894-21ea-4345-ace1-3a0724e544e9 on hv-cinder-81514 Oct 28 12:32:54.964179 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-24a772f3-c8f1-4d4b-8982-91ec0b18b300 req-1e6c1b50-a99e-462b-807f-7a3bc43efe0a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038632 Oct 28 12:32:54.964806 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 191/368] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:32:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:32:54.995353 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-9e4d265c-a2b8-4042-8d45-91977142a51b tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9342796ec00a4004be5d853d307a2411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbbbaba86b74b2184637e1cf58ec643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:55.003200 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-9e4d265c-a2b8-4042-8d45-91977142a51b tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/87852894-21ea-4345-ace1-3a0724e544e9" status: 200 len: 1462 microversion: 2.1 time: 0.123014 Oct 28 12:32:55.004033 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 178/369] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:54 2021] GET /compute/v2.1/servers/87852894-21ea-4345-ace1-3a0724e544e9 => generated 1462 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:55.192869 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-bdae3969-493c-47e5-9ca1-ba50c5e6d9c9 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:55.193708 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-bdae3969-493c-47e5-9ca1-ba50c5e6d9c9 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a02b0570-d3b8-4fe1-aa09-199f6525ac0c] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:55.202163 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-bdae3969-493c-47e5-9ca1-ba50c5e6d9c9 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:55.202584 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-bdae3969-493c-47e5-9ca1-ba50c5e6d9c9 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:55.203512 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-bdae3969-493c-47e5-9ca1-ba50c5e6d9c9 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:55.203947 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-bdae3969-493c-47e5-9ca1-ba50c5e6d9c9 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:55.230611 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-10d50652-d68d-49ca-8e22-a621a43c3903 req-19e4eacc-f3d4-4d87-a452-e041f357e708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a02b0570-d3b8-4fe1-aa09-199f6525ac0c", "name": "network-vif-plugged", "status": "completed", "tag": "d8c38e90-8225-4aaf-8322-139cc91fa0a9"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:55.232742 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:32:55.232742 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:32:55.241643 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-10d50652-d68d-49ca-8e22-a621a43c3903 req-19e4eacc-f3d4-4d87-a452-e041f357e708 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:55.242090 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-10d50652-d68d-49ca-8e22-a621a43c3903 req-19e4eacc-f3d4-4d87-a452-e041f357e708 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:55.267862 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-10d50652-d68d-49ca-8e22-a621a43c3903 req-19e4eacc-f3d4-4d87-a452-e041f357e708 service nova] Creating event network-vif-plugged:d8c38e90-8225-4aaf-8322-139cc91fa0a9 for instance a02b0570-d3b8-4fe1-aa09-199f6525ac0c on hv-cinder-81514 Oct 28 12:32:55.277330 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-10d50652-d68d-49ca-8e22-a621a43c3903 req-19e4eacc-f3d4-4d87-a452-e041f357e708 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050432 Oct 28 12:32:55.279254 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 179/370] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:32:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:32:55.360119 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-61d4a5a0-d99a-4ea0-af5e-13ac87fc290b tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:55.360745 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-bdae3969-493c-47e5-9ca1-ba50c5e6d9c9 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:55.360918 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-61d4a5a0-d99a-4ea0-af5e-13ac87fc290b tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:55.367119 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-61d4a5a0-d99a-4ea0-af5e-13ac87fc290b tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:55.367552 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-61d4a5a0-d99a-4ea0-af5e-13ac87fc290b tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:55.368318 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-61d4a5a0-d99a-4ea0-af5e-13ac87fc290b tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:55.368758 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-61d4a5a0-d99a-4ea0-af5e-13ac87fc290b tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:55.369021 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-bdae3969-493c-47e5-9ca1-ba50c5e6d9c9 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c" status: 200 len: 1267 microversion: 2.1 time: 0.184673 Oct 28 12:32:55.369966 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 192/371] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:55 2021] GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:55.509548 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-61d4a5a0-d99a-4ea0-af5e-13ac87fc290b tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:55.520440 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-61d4a5a0-d99a-4ea0-af5e-13ac87fc290b tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1721 microversion: 2.1 time: 0.166783 Oct 28 12:32:55.521485 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 180/372] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:55 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:55.615563 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-9a40345d-8d5c-46c1-8538-916defe83e12 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:55.616158 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-9a40345d-8d5c-46c1-8538-916defe83e12 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:55.624098 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9a40345d-8d5c-46c1-8538-916defe83e12 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:55.624822 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9a40345d-8d5c-46c1-8538-916defe83e12 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:55.625671 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9a40345d-8d5c-46c1-8538-916defe83e12 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:55.626139 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9a40345d-8d5c-46c1-8538-916defe83e12 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:55.762697 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-9a40345d-8d5c-46c1-8538-916defe83e12 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:55.776324 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-9a40345d-8d5c-46c1-8538-916defe83e12 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:55.778279 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-9a40345d-8d5c-46c1-8538-916defe83e12 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:55.780033 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-9a40345d-8d5c-46c1-8538-916defe83e12 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1724 microversion: 2.20 time: 0.168196 Oct 28 12:32:55.780777 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 193/373] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:32:55 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:32:55.870816 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-fc761276-f6ee-43da-9a35-27570cf00516 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:55.871475 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-fc761276-f6ee-43da-9a35-27570cf00516 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:55.878158 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fc761276-f6ee-43da-9a35-27570cf00516 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:55.878598 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fc761276-f6ee-43da-9a35-27570cf00516 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:55.879377 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fc761276-f6ee-43da-9a35-27570cf00516 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:55.879808 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fc761276-f6ee-43da-9a35-27570cf00516 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:56.007558 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-fc761276-f6ee-43da-9a35-27570cf00516 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:56.017906 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-fc761276-f6ee-43da-9a35-27570cf00516 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1566 microversion: 2.1 time: 0.151474 Oct 28 12:32:56.018499 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 181/374] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:55 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:56.023934 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-ab1a3507-f9c0-42b2-9070-aff1c0dd9827 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:56.024593 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-ab1a3507-f9c0-42b2-9070-aff1c0dd9827 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 87852894-21ea-4345-ace1-3a0724e544e9] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:56.030718 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ab1a3507-f9c0-42b2-9070-aff1c0dd9827 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:56.031188 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ab1a3507-f9c0-42b2-9070-aff1c0dd9827 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:56.031946 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ab1a3507-f9c0-42b2-9070-aff1c0dd9827 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:56.032421 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ab1a3507-f9c0-42b2-9070-aff1c0dd9827 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:56.045710 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.wsgi [None req-ab1a3507-f9c0-42b2-9070-aff1c0dd9827 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] HTTP exception thrown: Instance 87852894-21ea-4345-ace1-3a0724e544e9 could not be found. Oct 28 12:32:56.046316 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-ab1a3507-f9c0-42b2-9070-aff1c0dd9827 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Returning 404 to user: Instance 87852894-21ea-4345-ace1-3a0724e544e9 could not be found. {{(pid=115877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:32:56.047198 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-ab1a3507-f9c0-42b2-9070-aff1c0dd9827 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/87852894-21ea-4345-ace1-3a0724e544e9" status: 404 len: 111 microversion: 2.1 time: 0.027031 Oct 28 12:32:56.047734 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 194/375] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:56 2021] GET /compute/v2.1/servers/87852894-21ea-4345-ace1-3a0724e544e9 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:32:56.152039 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-9d5f8529-37e4-41ee-8cb8-a27e5ae3580c tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-901144437", "imageRef": "575f28c8-0af2-4973-b3d9-a249e2400c6e", "flavorRef": "452", "networks": [{"uuid": "f20ac26a-7429-439a-a4a0-e4320dff4b06"}]}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:56.207584 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.network.neutron [None req-9d5f8529-37e4-41ee-8cb8-a27e5ae3580c tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] validate_networks() for [('f20ac26a-7429-439a-a4a0-e4320dff4b06', None, None, None, None, None)] {{(pid=115876) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:32:56.387302 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-4495d82a-64b4-4a0e-a6e6-54aff0db81d6 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:56.387909 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-4495d82a-64b4-4a0e-a6e6-54aff0db81d6 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a02b0570-d3b8-4fe1-aa09-199f6525ac0c] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:56.393886 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4495d82a-64b4-4a0e-a6e6-54aff0db81d6 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:56.394330 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4495d82a-64b4-4a0e-a6e6-54aff0db81d6 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:56.395113 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4495d82a-64b4-4a0e-a6e6-54aff0db81d6 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:56.395539 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4495d82a-64b4-4a0e-a6e6-54aff0db81d6 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:56.605464 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-4495d82a-64b4-4a0e-a6e6-54aff0db81d6 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:56.614910 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-4495d82a-64b4-4a0e-a6e6-54aff0db81d6 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c" status: 200 len: 1267 microversion: 2.1 time: 0.231184 Oct 28 12:32:56.615421 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 195/376] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:56 2021] GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c => generated 1267 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:32:56.629679 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-744637fb-2ad0-4964-b412-cef7d3be675f tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:56.630324 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-744637fb-2ad0-4964-b412-cef7d3be675f tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:56.636790 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-744637fb-2ad0-4964-b412-cef7d3be675f tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:56.637943 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-744637fb-2ad0-4964-b412-cef7d3be675f tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:56.638638 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-9d5f8529-37e4-41ee-8cb8-a27e5ae3580c tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Flavor limits 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:32:56.638964 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-744637fb-2ad0-4964-b412-cef7d3be675f tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:56.639069 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-9d5f8529-37e4-41ee-8cb8-a27e5ae3580c tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Image limits 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:32:56.639531 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-9d5f8529-37e4-41ee-8cb8-a27e5ae3580c tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Flavor pref 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:32:56.639627 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-744637fb-2ad0-4964-b412-cef7d3be675f tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:56.639932 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-9d5f8529-37e4-41ee-8cb8-a27e5ae3580c tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Image pref 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:32:56.641066 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-9d5f8529-37e4-41ee-8cb8-a27e5ae3580c tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:32:56.651828 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9d5f8529-37e4-41ee-8cb8-a27e5ae3580c tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:56.652268 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9d5f8529-37e4-41ee-8cb8-a27e5ae3580c tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:56.653221 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9d5f8529-37e4-41ee-8cb8-a27e5ae3580c tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:56.653651 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9d5f8529-37e4-41ee-8cb8-a27e5ae3580c tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:56.670956 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-9d5f8529-37e4-41ee-8cb8-a27e5ae3580c tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Getting quotas for project 2fbbbaba86b74b2184637e1cf58ec643. Resources: {'cores', 'instances', 'ram'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:32:56.675273 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-9d5f8529-37e4-41ee-8cb8-a27e5ae3580c tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Getting quotas for user 9342796ec00a4004be5d853d307a2411 and project 2fbbbaba86b74b2184637e1cf58ec643. Resources: {'cores', 'instances', 'ram'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:32:56.686905 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-9d5f8529-37e4-41ee-8cb8-a27e5ae3580c tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Going to run 1 instances... {{(pid=115876) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:32:56.689898 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-9d5f8529-37e4-41ee-8cb8-a27e5ae3580c tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 2d2cccc7-6745-4322-9f87-e556cff9f2f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='575f28c8-0af2-4973-b3d9-a249e2400c6e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:32:56.739567 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-9d5f8529-37e4-41ee-8cb8-a27e5ae3580c tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.591014 Oct 28 12:32:56.740234 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 182/377] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Oct 28 12:32:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 12:32:56.750845 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-f64dbe86-9a34-4eb5-b6a9-bd87255e1285 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:56.751457 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-f64dbe86-9a34-4eb5-b6a9-bd87255e1285 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 2d2cccc7-6745-4322-9f87-e556cff9f2f7] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:56.831175 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f64dbe86-9a34-4eb5-b6a9-bd87255e1285 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9342796ec00a4004be5d853d307a2411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbbbaba86b74b2184637e1cf58ec643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:56.843240 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-f64dbe86-9a34-4eb5-b6a9-bd87255e1285 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7" status: 200 len: 1213 microversion: 2.1 time: 0.095503 Oct 28 12:32:56.844041 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 183/378] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:56 2021] GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7 => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:56.848989 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-57076c29-1755-453b-8e28-d1507fdc2272 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:56.849763 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-57076c29-1755-453b-8e28-d1507fdc2272 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:56.850946 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-744637fb-2ad0-4964-b412-cef7d3be675f tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:56.865548 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-744637fb-2ad0-4964-b412-cef7d3be675f tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1721 microversion: 2.1 time: 0.239506 Oct 28 12:32:56.875533 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-57076c29-1755-453b-8e28-d1507fdc2272 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:56.875533 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-57076c29-1755-453b-8e28-d1507fdc2272 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:56.875533 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-57076c29-1755-453b-8e28-d1507fdc2272 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:56.875533 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-57076c29-1755-453b-8e28-d1507fdc2272 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:56.877064 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 196/379] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:56 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1721 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:57.026519 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-57076c29-1755-453b-8e28-d1507fdc2272 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:57.037745 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-35a6c590-fdc1-4110-9239-4d5869bf74e5 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:57.038370 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-35a6c590-fdc1-4110-9239-4d5869bf74e5 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:57.046310 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-57076c29-1755-453b-8e28-d1507fdc2272 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:57.047888 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-57076c29-1755-453b-8e28-d1507fdc2272 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:57.049090 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-57076c29-1755-453b-8e28-d1507fdc2272 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1745 microversion: 2.20 time: 0.204272 Oct 28 12:32:57.049851 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 184/380] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:32:56 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1745 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:32:57.057161 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-35a6c590-fdc1-4110-9239-4d5869bf74e5 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:57.057839 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-35a6c590-fdc1-4110-9239-4d5869bf74e5 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:57.059032 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-35a6c590-fdc1-4110-9239-4d5869bf74e5 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:57.059456 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-35a6c590-fdc1-4110-9239-4d5869bf74e5 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:57.216347 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-35a6c590-fdc1-4110-9239-4d5869bf74e5 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:57.225944 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-35a6c590-fdc1-4110-9239-4d5869bf74e5 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1566 microversion: 2.1 time: 0.193654 Oct 28 12:32:57.233142 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 197/381] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:57 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1566 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:32:57.631861 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-c52e68ef-f5d7-4012-ba30-ec3e2cf7ea91 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:57.632463 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-c52e68ef-f5d7-4012-ba30-ec3e2cf7ea91 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a02b0570-d3b8-4fe1-aa09-199f6525ac0c] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:57.640552 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c52e68ef-f5d7-4012-ba30-ec3e2cf7ea91 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:57.641011 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c52e68ef-f5d7-4012-ba30-ec3e2cf7ea91 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:57.641819 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c52e68ef-f5d7-4012-ba30-ec3e2cf7ea91 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:57.642253 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c52e68ef-f5d7-4012-ba30-ec3e2cf7ea91 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:57.773877 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-c52e68ef-f5d7-4012-ba30-ec3e2cf7ea91 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:57.782962 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-c52e68ef-f5d7-4012-ba30-ec3e2cf7ea91 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c" status: 200 len: 1452 microversion: 2.1 time: 0.155091 Oct 28 12:32:57.783479 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 185/382] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:57 2021] GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:57.802395 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-e53355c3-17b5-4773-9f8c-1c585f5c4452 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:57.803081 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-e53355c3-17b5-4773-9f8c-1c585f5c4452 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a02b0570-d3b8-4fe1-aa09-199f6525ac0c] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:57.814466 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e53355c3-17b5-4773-9f8c-1c585f5c4452 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:57.814890 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e53355c3-17b5-4773-9f8c-1c585f5c4452 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:57.815670 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e53355c3-17b5-4773-9f8c-1c585f5c4452 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:57.816191 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e53355c3-17b5-4773-9f8c-1c585f5c4452 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:57.868470 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-c7bdb752-b86c-422a-ad3b-696713125c3a tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:57.869448 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-c7bdb752-b86c-422a-ad3b-696713125c3a tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 2d2cccc7-6745-4322-9f87-e556cff9f2f7] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:57.875990 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c7bdb752-b86c-422a-ad3b-696713125c3a tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:57.876609 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c7bdb752-b86c-422a-ad3b-696713125c3a tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:57.877236 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c7bdb752-b86c-422a-ad3b-696713125c3a tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:57.877664 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c7bdb752-b86c-422a-ad3b-696713125c3a tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:57.951850 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-c7bdb752-b86c-422a-ad3b-696713125c3a tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9342796ec00a4004be5d853d307a2411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbbbaba86b74b2184637e1cf58ec643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:57.963615 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-c7bdb752-b86c-422a-ad3b-696713125c3a tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7" status: 200 len: 1265 microversion: 2.1 time: 0.098963 Oct 28 12:32:57.964213 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 186/383] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:57 2021] GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7 => generated 1265 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:32:57.970577 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-cd0dfbf8-4dd6-4add-8d4e-523a03329540 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:57.971210 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-cd0dfbf8-4dd6-4add-8d4e-523a03329540 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:57.983542 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cd0dfbf8-4dd6-4add-8d4e-523a03329540 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:57.984008 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cd0dfbf8-4dd6-4add-8d4e-523a03329540 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:57.984858 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cd0dfbf8-4dd6-4add-8d4e-523a03329540 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:57.985291 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cd0dfbf8-4dd6-4add-8d4e-523a03329540 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:58.051117 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-e53355c3-17b5-4773-9f8c-1c585f5c4452 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:58.071209 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-e53355c3-17b5-4773-9f8c-1c585f5c4452 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c" status: 200 len: 1452 microversion: 2.1 time: 0.272677 Oct 28 12:32:58.072280 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 198/384] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:57 2021] GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c => generated 1452 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:58.082093 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-2473908d-191e-496f-b9d3-2cfaa54e3afa tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:58.082799 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-2473908d-191e-496f-b9d3-2cfaa54e3afa tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:58.095400 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2473908d-191e-496f-b9d3-2cfaa54e3afa tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:58.096295 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2473908d-191e-496f-b9d3-2cfaa54e3afa tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:58.097705 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2473908d-191e-496f-b9d3-2cfaa54e3afa tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:58.098699 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2473908d-191e-496f-b9d3-2cfaa54e3afa tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:58.297469 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-cd0dfbf8-4dd6-4add-8d4e-523a03329540 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:58.312703 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-cd0dfbf8-4dd6-4add-8d4e-523a03329540 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1721 microversion: 2.1 time: 0.347054 Oct 28 12:32:58.314314 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 187/385] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:57 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1721 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:58.322329 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-23b51ead-88bd-4960-892c-5d75e0b9f078 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:58.323670 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-23b51ead-88bd-4960-892c-5d75e0b9f078 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:58.333686 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-23b51ead-88bd-4960-892c-5d75e0b9f078 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:58.334405 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-23b51ead-88bd-4960-892c-5d75e0b9f078 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:58.335661 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-23b51ead-88bd-4960-892c-5d75e0b9f078 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:58.336164 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-23b51ead-88bd-4960-892c-5d75e0b9f078 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:58.469298 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-2473908d-191e-496f-b9d3-2cfaa54e3afa tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:58.478305 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-2473908d-191e-496f-b9d3-2cfaa54e3afa tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:58.480180 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-2473908d-191e-496f-b9d3-2cfaa54e3afa tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:58.488741 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-2473908d-191e-496f-b9d3-2cfaa54e3afa tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1745 microversion: 2.20 time: 0.407143 Oct 28 12:32:58.488741 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 199/386] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:32:58 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1745 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:32:58.606589 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-23b51ead-88bd-4960-892c-5d75e0b9f078 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:58.630986 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-23b51ead-88bd-4960-892c-5d75e0b9f078 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1566 microversion: 2.1 time: 0.312768 Oct 28 12:32:58.631609 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 188/387] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:58 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1566 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:58.982043 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-22074e41-c1f9-47d1-8ce3-84f977276441 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:58.982894 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-22074e41-c1f9-47d1-8ce3-84f977276441 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 2d2cccc7-6745-4322-9f87-e556cff9f2f7] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:58.996871 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-22074e41-c1f9-47d1-8ce3-84f977276441 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:58.998154 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-22074e41-c1f9-47d1-8ce3-84f977276441 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:58.999276 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-22074e41-c1f9-47d1-8ce3-84f977276441 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:58.999770 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-22074e41-c1f9-47d1-8ce3-84f977276441 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:59.282704 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-22074e41-c1f9-47d1-8ce3-84f977276441 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9342796ec00a4004be5d853d307a2411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbbbaba86b74b2184637e1cf58ec643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:59.290324 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-22074e41-c1f9-47d1-8ce3-84f977276441 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7" status: 200 len: 1313 microversion: 2.1 time: 0.312250 Oct 28 12:32:59.299878 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 200/388] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:58 2021] GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7 => generated 1313 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:32:59.314552 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-aedd5e59-c3d3-4705-9098-c917db7bbf16 req-965047e3-7d3e-42bc-be81-46810a365c73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6a3a830-8175-434e-8c23-336ccacf7ef8", "name": "network-vif-plugged", "status": "completed", "tag": "fd7216a9-4fe8-4770-a641-9f1115f86217"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:32:59.316329 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:32:59.316329 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:32:59.325848 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-aedd5e59-c3d3-4705-9098-c917db7bbf16 req-965047e3-7d3e-42bc-be81-46810a365c73 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:59.326584 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-aedd5e59-c3d3-4705-9098-c917db7bbf16 req-965047e3-7d3e-42bc-be81-46810a365c73 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:59.331590 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-f629fbec-cec6-475b-8cce-f6911f15f3c2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:59.332254 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-f629fbec-cec6-475b-8cce-f6911f15f3c2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:59.339195 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f629fbec-cec6-475b-8cce-f6911f15f3c2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:59.339664 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-aedd5e59-c3d3-4705-9098-c917db7bbf16 req-965047e3-7d3e-42bc-be81-46810a365c73 service nova] Creating event network-vif-plugged:fd7216a9-4fe8-4770-a641-9f1115f86217 for instance f6a3a830-8175-434e-8c23-336ccacf7ef8 on hv-cinder-81514 Oct 28 12:32:59.339955 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f629fbec-cec6-475b-8cce-f6911f15f3c2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:59.340779 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f629fbec-cec6-475b-8cce-f6911f15f3c2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:59.341271 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f629fbec-cec6-475b-8cce-f6911f15f3c2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:59.345348 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-aedd5e59-c3d3-4705-9098-c917db7bbf16 req-965047e3-7d3e-42bc-be81-46810a365c73 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034186 Oct 28 12:32:59.349704 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 189/389] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:32:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:32:59.513088 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-1ed85e4a-5af1-4d85-8327-aad2ce3de441 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:59.514182 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-1ed85e4a-5af1-4d85-8327-aad2ce3de441 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:59.521460 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1ed85e4a-5af1-4d85-8327-aad2ce3de441 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:59.522569 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1ed85e4a-5af1-4d85-8327-aad2ce3de441 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:59.523857 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1ed85e4a-5af1-4d85-8327-aad2ce3de441 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:59.525658 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1ed85e4a-5af1-4d85-8327-aad2ce3de441 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:59.897548 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-f629fbec-cec6-475b-8cce-f6911f15f3c2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:32:59.916919 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-f629fbec-cec6-475b-8cce-f6911f15f3c2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1721 microversion: 2.1 time: 0.589852 Oct 28 12:32:59.930919 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 201/390] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:59 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1721 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:32:59.930919 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-6e00db8d-1a32-42f7-aaf5-dfdf74a116a4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:32:59.931541 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-6e00db8d-1a32-42f7-aaf5-dfdf74a116a4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:32:59.943540 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6e00db8d-1a32-42f7-aaf5-dfdf74a116a4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:59.944283 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6e00db8d-1a32-42f7-aaf5-dfdf74a116a4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:59.945286 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6e00db8d-1a32-42f7-aaf5-dfdf74a116a4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:32:59.945873 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6e00db8d-1a32-42f7-aaf5-dfdf74a116a4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:32:59.993875 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-1ed85e4a-5af1-4d85-8327-aad2ce3de441 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:00.006510 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-1ed85e4a-5af1-4d85-8327-aad2ce3de441 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:00.008185 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-1ed85e4a-5af1-4d85-8327-aad2ce3de441 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:00.018783 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-1ed85e4a-5af1-4d85-8327-aad2ce3de441 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1740 microversion: 2.20 time: 0.511172 Oct 28 12:33:00.026835 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 190/391] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:32:59 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1740 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:33:00.254107 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-6e00db8d-1a32-42f7-aaf5-dfdf74a116a4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:00.266100 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-6e00db8d-1a32-42f7-aaf5-dfdf74a116a4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1546 microversion: 2.1 time: 0.341388 Oct 28 12:33:00.270143 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 202/392] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:32:59 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1546 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:00.286023 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-42963531-af96-4bc4-a4bc-05a22b117698 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:00.286744 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-42963531-af96-4bc4-a4bc-05a22b117698 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:00.293782 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-42963531-af96-4bc4-a4bc-05a22b117698 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:00.294323 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-42963531-af96-4bc4-a4bc-05a22b117698 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:00.295017 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-42963531-af96-4bc4-a4bc-05a22b117698 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:00.295497 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-42963531-af96-4bc4-a4bc-05a22b117698 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:00.308576 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-cbc3758a-83e4-4b15-91d5-2647dbe2b0a2 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:00.313381 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-cbc3758a-83e4-4b15-91d5-2647dbe2b0a2 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 2d2cccc7-6745-4322-9f87-e556cff9f2f7] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:00.326463 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-cbc3758a-83e4-4b15-91d5-2647dbe2b0a2 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:00.328397 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-cbc3758a-83e4-4b15-91d5-2647dbe2b0a2 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:00.330164 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-cbc3758a-83e4-4b15-91d5-2647dbe2b0a2 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:00.331660 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-cbc3758a-83e4-4b15-91d5-2647dbe2b0a2 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:00.520143 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.wsgi [None req-42963531-af96-4bc4-a4bc-05a22b117698 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] HTTP exception thrown: Cannot 'detach_volume' instance 358e5707-b5af-4ff5-9308-489054458c20 while it is in vm_state rescued Oct 28 12:33:00.521323 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-42963531-af96-4bc4-a4bc-05a22b117698 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Returning 409 to user: Cannot 'detach_volume' instance 358e5707-b5af-4ff5-9308-489054458c20 while it is in vm_state rescued {{(pid=115876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:33:00.522437 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-42963531-af96-4bc4-a4bc-05a22b117698 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "DELETE /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20/os-volume_attachments/a805c7ef-4b4b-431c-835c-b882c44767b6" status: 409 len: 152 microversion: 2.1 time: 0.240346 Oct 28 12:33:00.523463 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 191/393] 10.222.0.62 () {58 vars in 1415 bytes} [Thu Oct 28 12:33:00 2021] DELETE /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20/os-volume_attachments/a805c7ef-4b4b-431c-835c-b882c44767b6 => generated 152 bytes in 242 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 12:33:00.533908 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-deba66a9-a220-43a8-9fdd-381be7f7d42a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:33:00.542271 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-deba66a9-a220-43a8-9fdd-381be7f7d42a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:00.556582 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-deba66a9-a220-43a8-9fdd-381be7f7d42a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:00.557343 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-deba66a9-a220-43a8-9fdd-381be7f7d42a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:00.558757 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-deba66a9-a220-43a8-9fdd-381be7f7d42a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:00.559337 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-deba66a9-a220-43a8-9fdd-381be7f7d42a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:00.589145 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-cbc3758a-83e4-4b15-91d5-2647dbe2b0a2 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9342796ec00a4004be5d853d307a2411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbbbaba86b74b2184637e1cf58ec643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:00.609053 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-cbc3758a-83e4-4b15-91d5-2647dbe2b0a2 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7" status: 200 len: 1313 microversion: 2.1 time: 0.305228 Oct 28 12:33:00.613928 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 203/394] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:00 2021] GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7 => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:33:00.689109 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-c4744247-b665-49ad-a5fd-a0b6366ecc08 req-7ea08bf4-8bc3-4abd-b973-ca67290ea261 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d2cccc7-6745-4322-9f87-e556cff9f2f7", "tag": "3bac65dc-2a0c-40dd-a1b2-568bc53579bf"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:33:00.691101 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:33:00.691101 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:33:00.706970 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-c4744247-b665-49ad-a5fd-a0b6366ecc08 req-7ea08bf4-8bc3-4abd-b973-ca67290ea261 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:00.707814 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-c4744247-b665-49ad-a5fd-a0b6366ecc08 req-7ea08bf4-8bc3-4abd-b973-ca67290ea261 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:00.726032 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-deba66a9-a220-43a8-9fdd-381be7f7d42a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "POST /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20/action" status: 202 len: 0 microversion: 2.1 time: 0.196798 Oct 28 12:33:00.731234 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 192/395] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:33:00 2021] POST /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:33:00.736213 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-c4744247-b665-49ad-a5fd-a0b6366ecc08 req-7ea08bf4-8bc3-4abd-b973-ca67290ea261 service nova] Creating event network-changed:3bac65dc-2a0c-40dd-a1b2-568bc53579bf for instance 2d2cccc7-6745-4322-9f87-e556cff9f2f7 on hv-cinder-81514 Oct 28 12:33:00.741324 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-522e7d6f-53b9-417c-bf84-cdc9244bbebe tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:00.743662 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-522e7d6f-53b9-417c-bf84-cdc9244bbebe tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:00.752538 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-c4744247-b665-49ad-a5fd-a0b6366ecc08 req-7ea08bf4-8bc3-4abd-b973-ca67290ea261 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067785 Oct 28 12:33:00.753665 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 204/396] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:33:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:33:00.754715 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-522e7d6f-53b9-417c-bf84-cdc9244bbebe tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:00.755327 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-522e7d6f-53b9-417c-bf84-cdc9244bbebe tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:00.756340 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-522e7d6f-53b9-417c-bf84-cdc9244bbebe tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:00.756954 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-522e7d6f-53b9-417c-bf84-cdc9244bbebe tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:00.939521 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-80815742-6a2a-4e5e-a500-8ed5139e9781 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:00.940343 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-80815742-6a2a-4e5e-a500-8ed5139e9781 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:00.958930 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-80815742-6a2a-4e5e-a500-8ed5139e9781 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:00.959474 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-80815742-6a2a-4e5e-a500-8ed5139e9781 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:00.960360 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-80815742-6a2a-4e5e-a500-8ed5139e9781 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:00.960945 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-80815742-6a2a-4e5e-a500-8ed5139e9781 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:01.216194 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-522e7d6f-53b9-417c-bf84-cdc9244bbebe tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:01.231488 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-522e7d6f-53b9-417c-bf84-cdc9244bbebe tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1554 microversion: 2.1 time: 0.495775 Oct 28 12:33:01.233885 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 193/397] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:00 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1554 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:01.243950 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-f5f29682-b016-4936-817f-d27f45f43237 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:01.244963 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-f5f29682-b016-4936-817f-d27f45f43237 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:01.264371 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f5f29682-b016-4936-817f-d27f45f43237 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:01.265117 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f5f29682-b016-4936-817f-d27f45f43237 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:01.266253 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f5f29682-b016-4936-817f-d27f45f43237 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:01.267040 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f5f29682-b016-4936-817f-d27f45f43237 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:01.460952 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-80815742-6a2a-4e5e-a500-8ed5139e9781 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:01.471903 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-80815742-6a2a-4e5e-a500-8ed5139e9781 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1721 microversion: 2.1 time: 0.536058 Oct 28 12:33:01.478353 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 205/398] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:00 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1721 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:33:01.491621 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-21cff411-f102-4cb0-adc0-19aa7000047e req-f788cfef-9055-40ed-84c7-51cc582af735 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a02b0570-d3b8-4fe1-aa09-199f6525ac0c", "tag": "d8c38e90-8225-4aaf-8322-139cc91fa0a9"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:33:01.497298 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:33:01.497298 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:33:01.510523 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-21cff411-f102-4cb0-adc0-19aa7000047e req-f788cfef-9055-40ed-84c7-51cc582af735 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:01.511343 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-21cff411-f102-4cb0-adc0-19aa7000047e req-f788cfef-9055-40ed-84c7-51cc582af735 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:01.558268 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-21cff411-f102-4cb0-adc0-19aa7000047e req-f788cfef-9055-40ed-84c7-51cc582af735 service nova] Creating event network-changed:d8c38e90-8225-4aaf-8322-139cc91fa0a9 for instance a02b0570-d3b8-4fe1-aa09-199f6525ac0c on hv-cinder-81514 Oct 28 12:33:01.652132 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-21cff411-f102-4cb0-adc0-19aa7000047e req-f788cfef-9055-40ed-84c7-51cc582af735 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170929 Oct 28 12:33:01.653143 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 206/399] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:33:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:33:01.664084 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-bbed963b-9ba7-4d56-ab76-d510c6a036d0 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:01.670557 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-bbed963b-9ba7-4d56-ab76-d510c6a036d0 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 2d2cccc7-6745-4322-9f87-e556cff9f2f7] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:01.680587 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-bbed963b-9ba7-4d56-ab76-d510c6a036d0 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:01.681498 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-bbed963b-9ba7-4d56-ab76-d510c6a036d0 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:01.682551 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-bbed963b-9ba7-4d56-ab76-d510c6a036d0 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:01.683559 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-bbed963b-9ba7-4d56-ab76-d510c6a036d0 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:01.699702 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f5f29682-b016-4936-817f-d27f45f43237 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:01.707981 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f5f29682-b016-4936-817f-d27f45f43237 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:01.709519 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f5f29682-b016-4936-817f-d27f45f43237 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:01.710693 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-f5f29682-b016-4936-817f-d27f45f43237 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1740 microversion: 2.20 time: 0.475182 Oct 28 12:33:01.711313 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 194/400] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:01 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1740 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:01.949791 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-bbed963b-9ba7-4d56-ab76-d510c6a036d0 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9342796ec00a4004be5d853d307a2411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbbbaba86b74b2184637e1cf58ec643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:01.991390 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-bbed963b-9ba7-4d56-ab76-d510c6a036d0 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7" status: 200 len: 1313 microversion: 2.1 time: 0.336716 Oct 28 12:33:01.992578 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 207/401] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:01 2021] GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7 => generated 1313 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:02.252192 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-57c21435-fb68-4bcb-a46b-4187a4370dd5 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:02.252964 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-57c21435-fb68-4bcb-a46b-4187a4370dd5 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:02.262831 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-57c21435-fb68-4bcb-a46b-4187a4370dd5 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:02.264238 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-57c21435-fb68-4bcb-a46b-4187a4370dd5 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:02.265248 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-57c21435-fb68-4bcb-a46b-4187a4370dd5 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:02.265857 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-57c21435-fb68-4bcb-a46b-4187a4370dd5 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:02.489808 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-037e5dc9-44ce-4c1b-b40c-23089ac1ec4c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:02.491065 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-037e5dc9-44ce-4c1b-b40c-23089ac1ec4c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:02.502471 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-037e5dc9-44ce-4c1b-b40c-23089ac1ec4c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:02.504053 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-037e5dc9-44ce-4c1b-b40c-23089ac1ec4c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:02.508114 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-037e5dc9-44ce-4c1b-b40c-23089ac1ec4c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:02.509533 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-037e5dc9-44ce-4c1b-b40c-23089ac1ec4c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:02.583119 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-57c21435-fb68-4bcb-a46b-4187a4370dd5 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:02.600957 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-57c21435-fb68-4bcb-a46b-4187a4370dd5 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1554 microversion: 2.1 time: 0.349590 Oct 28 12:33:02.610812 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 195/402] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:02 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1554 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:02.730433 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-87ccca60-0a9c-401e-b454-741b10e29914 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:02.731107 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-87ccca60-0a9c-401e-b454-741b10e29914 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:02.746796 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-037e5dc9-44ce-4c1b-b40c-23089ac1ec4c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:02.749075 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-87ccca60-0a9c-401e-b454-741b10e29914 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:02.749586 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-87ccca60-0a9c-401e-b454-741b10e29914 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:02.750517 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-87ccca60-0a9c-401e-b454-741b10e29914 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:02.751128 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-87ccca60-0a9c-401e-b454-741b10e29914 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:02.763106 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-037e5dc9-44ce-4c1b-b40c-23089ac1ec4c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1721 microversion: 2.1 time: 0.277021 Oct 28 12:33:02.774581 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 208/403] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:02 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1721 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:33:02.984588 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-87ccca60-0a9c-401e-b454-741b10e29914 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:02.997368 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-87ccca60-0a9c-401e-b454-741b10e29914 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:02.998860 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-87ccca60-0a9c-401e-b454-741b10e29914 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:03.000102 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-87ccca60-0a9c-401e-b454-741b10e29914 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1740 microversion: 2.20 time: 0.273597 Oct 28 12:33:03.000659 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 196/404] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:02 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1740 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:03.016140 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-39c889d1-60b3-44a2-b905-1cc23947a546 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:03.016655 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-39c889d1-60b3-44a2-b905-1cc23947a546 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 2d2cccc7-6745-4322-9f87-e556cff9f2f7] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:03.024665 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-39c889d1-60b3-44a2-b905-1cc23947a546 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:03.025581 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-39c889d1-60b3-44a2-b905-1cc23947a546 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:03.026376 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-39c889d1-60b3-44a2-b905-1cc23947a546 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:03.026799 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-39c889d1-60b3-44a2-b905-1cc23947a546 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:03.193962 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-39c889d1-60b3-44a2-b905-1cc23947a546 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9342796ec00a4004be5d853d307a2411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbbbaba86b74b2184637e1cf58ec643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:03.202277 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-39c889d1-60b3-44a2-b905-1cc23947a546 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7" status: 200 len: 1313 microversion: 2.1 time: 0.190056 Oct 28 12:33:03.212819 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 209/405] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:03 2021] GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7 => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:03.501124 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-282fcffd-d7ce-4eee-911e-14e483b9cba5 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0987204-b0c9-4c1c-b352-062d06f012c1", "device": "/dev/sdb"}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:33:03.502732 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-282fcffd-d7ce-4eee-911e-14e483b9cba5 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: e9dc74b0-0412-4f1d-ba9f-18c7b792df75] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:03.510034 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-282fcffd-d7ce-4eee-911e-14e483b9cba5 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:03.510485 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-282fcffd-d7ce-4eee-911e-14e483b9cba5 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:03.511261 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-282fcffd-d7ce-4eee-911e-14e483b9cba5 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:03.511697 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-282fcffd-d7ce-4eee-911e-14e483b9cba5 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:03.619540 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-3779704f-cb3c-44cb-9edc-249df0da7adb tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:03.621157 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-3779704f-cb3c-44cb-9edc-249df0da7adb tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:03.627652 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3779704f-cb3c-44cb-9edc-249df0da7adb tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:03.628321 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3779704f-cb3c-44cb-9edc-249df0da7adb tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:03.629330 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3779704f-cb3c-44cb-9edc-249df0da7adb tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:03.629930 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3779704f-cb3c-44cb-9edc-249df0da7adb tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:03.784219 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-3779704f-cb3c-44cb-9edc-249df0da7adb tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:03.792066 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-3779704f-cb3c-44cb-9edc-249df0da7adb tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1554 microversion: 2.1 time: 0.177284 Oct 28 12:33:03.801943 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 210/406] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:03 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:33:03.801943 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-aad8c963-054f-4c37-8414-e0a08510cce7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:03.801943 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-aad8c963-054f-4c37-8414-e0a08510cce7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:03.805307 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-aad8c963-054f-4c37-8414-e0a08510cce7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:03.805886 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-aad8c963-054f-4c37-8414-e0a08510cce7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:03.806853 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-aad8c963-054f-4c37-8414-e0a08510cce7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:03.807448 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-aad8c963-054f-4c37-8414-e0a08510cce7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:03.840448 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-282fcffd-d7ce-4eee-911e-14e483b9cba5 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "POST /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.342926 Oct 28 12:33:03.841118 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 197/407] 10.222.0.62 () {60 vars in 1322 bytes} [Thu Oct 28 12:33:03 2021] POST /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75/os-volume_attachments => generated 194 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:33:03.972293 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-aad8c963-054f-4c37-8414-e0a08510cce7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:03.982938 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-aad8c963-054f-4c37-8414-e0a08510cce7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1721 microversion: 2.1 time: 0.188278 Oct 28 12:33:03.985090 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 211/408] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:03 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:04.020041 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-5b4aa80f-6beb-469a-8fbe-a6817882c874 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:04.020781 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-5b4aa80f-6beb-469a-8fbe-a6817882c874 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:04.031846 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5b4aa80f-6beb-469a-8fbe-a6817882c874 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:04.032287 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5b4aa80f-6beb-469a-8fbe-a6817882c874 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:04.033099 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5b4aa80f-6beb-469a-8fbe-a6817882c874 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:04.033523 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5b4aa80f-6beb-469a-8fbe-a6817882c874 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:04.203785 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-5b4aa80f-6beb-469a-8fbe-a6817882c874 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:04.213181 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-5b4aa80f-6beb-469a-8fbe-a6817882c874 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:04.214675 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-5b4aa80f-6beb-469a-8fbe-a6817882c874 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:04.215832 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-5b4aa80f-6beb-469a-8fbe-a6817882c874 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1740 microversion: 2.20 time: 0.200051 Oct 28 12:33:04.219416 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-89010fb4-0e75-4665-8ade-0b137a098c4d tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:04.220242 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-89010fb4-0e75-4665-8ade-0b137a098c4d tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 2d2cccc7-6745-4322-9f87-e556cff9f2f7] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:04.226510 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-89010fb4-0e75-4665-8ade-0b137a098c4d tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:04.227175 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-89010fb4-0e75-4665-8ade-0b137a098c4d tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:04.228229 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-89010fb4-0e75-4665-8ade-0b137a098c4d tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:04.228415 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 198/409] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:04 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1740 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:04.229051 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-89010fb4-0e75-4665-8ade-0b137a098c4d tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:04.370711 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-89010fb4-0e75-4665-8ade-0b137a098c4d tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9342796ec00a4004be5d853d307a2411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbbbaba86b74b2184637e1cf58ec643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:04.379588 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-89010fb4-0e75-4665-8ade-0b137a098c4d tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7" status: 200 len: 1313 microversion: 2.1 time: 0.163810 Oct 28 12:33:04.380396 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 212/410] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:04 2021] GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:33:04.813771 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-1df71b64-8c3b-4c45-b534-57a28f8539d4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:04.814308 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-1df71b64-8c3b-4c45-b534-57a28f8539d4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:04.830321 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1df71b64-8c3b-4c45-b534-57a28f8539d4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:04.830973 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1df71b64-8c3b-4c45-b534-57a28f8539d4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:04.832661 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1df71b64-8c3b-4c45-b534-57a28f8539d4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:04.833220 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1df71b64-8c3b-4c45-b534-57a28f8539d4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:04.989135 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-1df71b64-8c3b-4c45-b534-57a28f8539d4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:04.999657 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-1df71b64-8c3b-4c45-b534-57a28f8539d4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1560 microversion: 2.1 time: 0.193716 Oct 28 12:33:05.000413 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 199/411] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:04 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1560 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:05.004190 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-fd92aa2f-8661-4104-865b-00c49e00e6ec tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:05.005452 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-fd92aa2f-8661-4104-865b-00c49e00e6ec tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:05.014812 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fd92aa2f-8661-4104-865b-00c49e00e6ec tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:05.015597 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fd92aa2f-8661-4104-865b-00c49e00e6ec tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:05.016382 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fd92aa2f-8661-4104-865b-00c49e00e6ec tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:05.016852 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fd92aa2f-8661-4104-865b-00c49e00e6ec tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:05.080788 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-2c305682-0a7d-47ff-96b3-d457f68496ad tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:05.081345 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-2c305682-0a7d-47ff-96b3-d457f68496ad tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:05.090574 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2c305682-0a7d-47ff-96b3-d457f68496ad tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:05.091115 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2c305682-0a7d-47ff-96b3-d457f68496ad tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:05.095492 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2c305682-0a7d-47ff-96b3-d457f68496ad tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:05.096015 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2c305682-0a7d-47ff-96b3-d457f68496ad tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:05.207917 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-fd92aa2f-8661-4104-865b-00c49e00e6ec tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:05.217600 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-fd92aa2f-8661-4104-865b-00c49e00e6ec tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1698 microversion: 2.1 time: 0.217387 Oct 28 12:33:05.218287 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 213/412] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:04 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1698 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:33:05.238145 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-be28c983-e824-48f0-80c2-38cd8fdd7511 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:05.238967 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-be28c983-e824-48f0-80c2-38cd8fdd7511 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:05.246499 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-be28c983-e824-48f0-80c2-38cd8fdd7511 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:05.247036 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-be28c983-e824-48f0-80c2-38cd8fdd7511 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:05.248013 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-be28c983-e824-48f0-80c2-38cd8fdd7511 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:05.248541 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-be28c983-e824-48f0-80c2-38cd8fdd7511 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:05.258826 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.objects.instance [None req-2c305682-0a7d-47ff-96b3-d457f68496ad tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lazy-loading 'services' on Instance uuid 358e5707-b5af-4ff5-9308-489054458c20 {{(pid=115876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:33:05.434918 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-2c305682-0a7d-47ff-96b3-d457f68496ad tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "DELETE /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20/os-volume_attachments/a805c7ef-4b4b-431c-835c-b882c44767b6" status: 202 len: 0 microversion: 2.1 time: 0.357629 Oct 28 12:33:05.440012 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 200/413] 10.222.0.62 () {58 vars in 1415 bytes} [Thu Oct 28 12:33:05 2021] DELETE /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20/os-volume_attachments/a805c7ef-4b4b-431c-835c-b882c44767b6 => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:33:05.442384 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-d94b0a63-ff64-493e-9ea3-2aeaf181cba8 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:33:05.461136 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d94b0a63-ff64-493e-9ea3-2aeaf181cba8 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:05.461650 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d94b0a63-ff64-493e-9ea3-2aeaf181cba8 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:05.550816 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-be28c983-e824-48f0-80c2-38cd8fdd7511 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:05.568458 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-be28c983-e824-48f0-80c2-38cd8fdd7511 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:05.571898 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-be28c983-e824-48f0-80c2-38cd8fdd7511 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:05.574349 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-be28c983-e824-48f0-80c2-38cd8fdd7511 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1740 microversion: 2.20 time: 0.341735 Oct 28 12:33:05.575839 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 214/414] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:05 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1740 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:05.583577 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-148a125c-1084-4bb0-b170-20567893c19f tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:05.584759 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-148a125c-1084-4bb0-b170-20567893c19f tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 2d2cccc7-6745-4322-9f87-e556cff9f2f7] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:05.595175 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-148a125c-1084-4bb0-b170-20567893c19f tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:05.596069 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-148a125c-1084-4bb0-b170-20567893c19f tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:05.597854 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-148a125c-1084-4bb0-b170-20567893c19f tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:05.598710 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-148a125c-1084-4bb0-b170-20567893c19f tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:05.653276 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-d94b0a63-ff64-493e-9ea3-2aeaf181cba8 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Going to try to start instance {{(pid=115876) start /opt/stack/nova/nova/compute/api.py:2675}} Oct 28 12:33:05.757331 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-d94b0a63-ff64-493e-9ea3-2aeaf181cba8 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 202 len: 0 microversion: 2.1 time: 0.319813 Oct 28 12:33:05.759908 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 201/415] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:33:05 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:33:05.790431 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-75487c55-6859-4062-bf61-d5c3b6587d67 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:05.802391 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-75487c55-6859-4062-bf61-d5c3b6587d67 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:05.819095 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-75487c55-6859-4062-bf61-d5c3b6587d67 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:05.819873 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-75487c55-6859-4062-bf61-d5c3b6587d67 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:05.821115 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-75487c55-6859-4062-bf61-d5c3b6587d67 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:05.821721 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-75487c55-6859-4062-bf61-d5c3b6587d67 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:05.867894 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-75487c55-6859-4062-bf61-d5c3b6587d67 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106438 Oct 28 12:33:05.868918 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 202/416] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Oct 28 12:33:05 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:33:05.869096 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-148a125c-1084-4bb0-b170-20567893c19f tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9342796ec00a4004be5d853d307a2411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbbbaba86b74b2184637e1cf58ec643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:05.878270 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-148a125c-1084-4bb0-b170-20567893c19f tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7" status: 200 len: 1313 microversion: 2.1 time: 0.300889 Oct 28 12:33:05.880042 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-41e44ede-bceb-4155-ab4a-a1f5f19510fa tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:05.880916 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 215/417] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:05 2021] GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7 => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:05.881310 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-41e44ede-bceb-4155-ab4a-a1f5f19510fa tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:05.893075 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-41e44ede-bceb-4155-ab4a-a1f5f19510fa tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:05.893817 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-41e44ede-bceb-4155-ab4a-a1f5f19510fa tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:05.894815 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-41e44ede-bceb-4155-ab4a-a1f5f19510fa tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:05.896031 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-41e44ede-bceb-4155-ab4a-a1f5f19510fa tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:06.097090 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-41e44ede-bceb-4155-ab4a-a1f5f19510fa tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:06.113025 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-41e44ede-bceb-4155-ab4a-a1f5f19510fa tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1707 microversion: 2.1 time: 0.241628 Oct 28 12:33:06.114217 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 203/418] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:05 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1707 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:06.600348 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-ffb29878-b11d-4476-b3e1-146945e95c33 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:06.601651 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-ffb29878-b11d-4476-b3e1-146945e95c33 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:06.608857 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ffb29878-b11d-4476-b3e1-146945e95c33 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:06.609849 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ffb29878-b11d-4476-b3e1-146945e95c33 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:06.610832 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ffb29878-b11d-4476-b3e1-146945e95c33 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:06.611429 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ffb29878-b11d-4476-b3e1-146945e95c33 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:06.796953 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-ffb29878-b11d-4476-b3e1-146945e95c33 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:06.806930 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-ffb29878-b11d-4476-b3e1-146945e95c33 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:06.809311 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-ffb29878-b11d-4476-b3e1-146945e95c33 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:06.810536 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-ffb29878-b11d-4476-b3e1-146945e95c33 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1740 microversion: 2.20 time: 0.213988 Oct 28 12:33:06.811238 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 216/419] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:06 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1740 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:06.883367 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-43cba315-e659-44cf-814a-47335eac1e2f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:06.884182 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-43cba315-e659-44cf-814a-47335eac1e2f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:06.892088 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-43cba315-e659-44cf-814a-47335eac1e2f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:06.892537 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-43cba315-e659-44cf-814a-47335eac1e2f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:06.893376 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-43cba315-e659-44cf-814a-47335eac1e2f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:06.893807 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-43cba315-e659-44cf-814a-47335eac1e2f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:06.897555 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-94b7bfb1-5cba-4c4b-af99-5eec5541a0a2 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:06.898254 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-94b7bfb1-5cba-4c4b-af99-5eec5541a0a2 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 2d2cccc7-6745-4322-9f87-e556cff9f2f7] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:06.919121 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-94b7bfb1-5cba-4c4b-af99-5eec5541a0a2 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:06.920161 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-94b7bfb1-5cba-4c4b-af99-5eec5541a0a2 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:06.922058 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-94b7bfb1-5cba-4c4b-af99-5eec5541a0a2 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:06.922750 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-94b7bfb1-5cba-4c4b-af99-5eec5541a0a2 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:06.944776 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-43cba315-e659-44cf-814a-47335eac1e2f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066101 Oct 28 12:33:06.945479 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 204/420] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Oct 28 12:33:06 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:33:07.081556 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-94b7bfb1-5cba-4c4b-af99-5eec5541a0a2 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9342796ec00a4004be5d853d307a2411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbbbaba86b74b2184637e1cf58ec643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:07.096078 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-94b7bfb1-5cba-4c4b-af99-5eec5541a0a2 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7" status: 200 len: 1313 microversion: 2.1 time: 0.202673 Oct 28 12:33:07.098926 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 217/421] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:06 2021] GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7 => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:33:07.130944 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-042cce45-8993-42c5-aad8-0051bbed907c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:07.131651 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-042cce45-8993-42c5-aad8-0051bbed907c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:07.144470 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-042cce45-8993-42c5-aad8-0051bbed907c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:07.145595 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-042cce45-8993-42c5-aad8-0051bbed907c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:07.151378 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-042cce45-8993-42c5-aad8-0051bbed907c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:07.152480 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-042cce45-8993-42c5-aad8-0051bbed907c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:07.323101 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-042cce45-8993-42c5-aad8-0051bbed907c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:07.331802 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-042cce45-8993-42c5-aad8-0051bbed907c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1707 microversion: 2.1 time: 0.205047 Oct 28 12:33:07.332838 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 205/422] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:07 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1707 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:07.354117 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-41dee0ce-b778-4f49-9c14-8ae9480005c1 req-d9a4ef99-eff1-4ca1-9a69-2734130e90f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d2cccc7-6745-4322-9f87-e556cff9f2f7", "name": "network-vif-plugged", "status": "completed", "tag": "3bac65dc-2a0c-40dd-a1b2-568bc53579bf"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:33:07.355791 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:33:07.355791 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:33:07.363053 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-41dee0ce-b778-4f49-9c14-8ae9480005c1 req-d9a4ef99-eff1-4ca1-9a69-2734130e90f8 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:07.363488 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-41dee0ce-b778-4f49-9c14-8ae9480005c1 req-d9a4ef99-eff1-4ca1-9a69-2734130e90f8 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:07.375684 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-41dee0ce-b778-4f49-9c14-8ae9480005c1 req-d9a4ef99-eff1-4ca1-9a69-2734130e90f8 service nova] Creating event network-vif-plugged:3bac65dc-2a0c-40dd-a1b2-568bc53579bf for instance 2d2cccc7-6745-4322-9f87-e556cff9f2f7 on hv-cinder-81514 Oct 28 12:33:07.381031 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-41dee0ce-b778-4f49-9c14-8ae9480005c1 req-d9a4ef99-eff1-4ca1-9a69-2734130e90f8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030775 Oct 28 12:33:07.381916 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 218/423] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:33:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:33:07.829618 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-2cd2b4e5-b179-4ab5-a3d8-2bb347891648 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:07.830542 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-2cd2b4e5-b179-4ab5-a3d8-2bb347891648 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:07.838651 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2cd2b4e5-b179-4ab5-a3d8-2bb347891648 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:07.839261 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2cd2b4e5-b179-4ab5-a3d8-2bb347891648 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:07.840196 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2cd2b4e5-b179-4ab5-a3d8-2bb347891648 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:07.840785 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2cd2b4e5-b179-4ab5-a3d8-2bb347891648 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:07.957518 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-c8ff2940-56f8-4b79-aabb-4e7c6e611415 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:07.958710 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-c8ff2940-56f8-4b79-aabb-4e7c6e611415 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:07.965371 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c8ff2940-56f8-4b79-aabb-4e7c6e611415 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:07.966521 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c8ff2940-56f8-4b79-aabb-4e7c6e611415 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:07.967589 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c8ff2940-56f8-4b79-aabb-4e7c6e611415 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:07.968771 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c8ff2940-56f8-4b79-aabb-4e7c6e611415 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:07.989976 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-2cd2b4e5-b179-4ab5-a3d8-2bb347891648 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:08.000437 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-2cd2b4e5-b179-4ab5-a3d8-2bb347891648 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:08.002274 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-2cd2b4e5-b179-4ab5-a3d8-2bb347891648 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:08.003754 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-2cd2b4e5-b179-4ab5-a3d8-2bb347891648 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1740 microversion: 2.20 time: 0.178156 Oct 28 12:33:08.004377 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-c8ff2940-56f8-4b79-aabb-4e7c6e611415 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050014 Oct 28 12:33:08.008464 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 219/424] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Oct 28 12:33:07 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:33:08.013130 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 206/425] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:07 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:08.116055 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-6622c065-165a-4e49-a992-c2b22e76b6e2 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:08.116635 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-6622c065-165a-4e49-a992-c2b22e76b6e2 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 2d2cccc7-6745-4322-9f87-e556cff9f2f7] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:08.123459 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6622c065-165a-4e49-a992-c2b22e76b6e2 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:08.123894 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6622c065-165a-4e49-a992-c2b22e76b6e2 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:08.124664 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6622c065-165a-4e49-a992-c2b22e76b6e2 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:08.125134 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6622c065-165a-4e49-a992-c2b22e76b6e2 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:08.296107 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-6622c065-165a-4e49-a992-c2b22e76b6e2 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9342796ec00a4004be5d853d307a2411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbbbaba86b74b2184637e1cf58ec643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:08.304310 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-6622c065-165a-4e49-a992-c2b22e76b6e2 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7" status: 200 len: 1313 microversion: 2.1 time: 0.192351 Oct 28 12:33:08.305018 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 220/426] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:08 2021] GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:08.350160 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-87218ad6-30a3-4dc5-b0b1-50f950f5c787 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:08.350949 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-87218ad6-30a3-4dc5-b0b1-50f950f5c787 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:08.360236 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-87218ad6-30a3-4dc5-b0b1-50f950f5c787 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:08.360874 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-87218ad6-30a3-4dc5-b0b1-50f950f5c787 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:08.361890 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-87218ad6-30a3-4dc5-b0b1-50f950f5c787 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:08.362355 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-87218ad6-30a3-4dc5-b0b1-50f950f5c787 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:08.531378 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-87218ad6-30a3-4dc5-b0b1-50f950f5c787 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:08.543486 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-87218ad6-30a3-4dc5-b0b1-50f950f5c787 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1711 microversion: 2.1 time: 0.197081 Oct 28 12:33:08.544231 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 207/427] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:08 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1711 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:09.015778 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-6c7989f8-bb22-49c3-a779-69c46f20c9c3 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:09.017910 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-6c7989f8-bb22-49c3-a779-69c46f20c9c3 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:09.021569 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-f748dc4b-1506-4c52-b03c-e57fea4a1252 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:09.022143 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-f748dc4b-1506-4c52-b03c-e57fea4a1252 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:09.026377 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6c7989f8-bb22-49c3-a779-69c46f20c9c3 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:09.027403 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6c7989f8-bb22-49c3-a779-69c46f20c9c3 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:09.028779 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6c7989f8-bb22-49c3-a779-69c46f20c9c3 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:09.029448 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6c7989f8-bb22-49c3-a779-69c46f20c9c3 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:09.030626 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f748dc4b-1506-4c52-b03c-e57fea4a1252 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:09.031084 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f748dc4b-1506-4c52-b03c-e57fea4a1252 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:09.032055 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f748dc4b-1506-4c52-b03c-e57fea4a1252 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:09.032492 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f748dc4b-1506-4c52-b03c-e57fea4a1252 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:09.073041 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-6c7989f8-bb22-49c3-a779-69c46f20c9c3 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061062 Oct 28 12:33:09.074029 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 221/428] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Oct 28 12:33:09 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:33:09.183172 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f748dc4b-1506-4c52-b03c-e57fea4a1252 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:09.192950 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f748dc4b-1506-4c52-b03c-e57fea4a1252 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:09.194992 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f748dc4b-1506-4c52-b03c-e57fea4a1252 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:09.197175 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-f748dc4b-1506-4c52-b03c-e57fea4a1252 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1740 microversion: 2.20 time: 0.178655 Oct 28 12:33:09.197175 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 208/429] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:09 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:33:09.331454 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-c2b2e0ff-565d-455f-b68d-fc8cae448933 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:09.331454 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-c2b2e0ff-565d-455f-b68d-fc8cae448933 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 2d2cccc7-6745-4322-9f87-e556cff9f2f7] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:09.338974 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c2b2e0ff-565d-455f-b68d-fc8cae448933 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:09.338974 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c2b2e0ff-565d-455f-b68d-fc8cae448933 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:09.338974 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c2b2e0ff-565d-455f-b68d-fc8cae448933 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:09.339727 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c2b2e0ff-565d-455f-b68d-fc8cae448933 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:09.543680 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-c2b2e0ff-565d-455f-b68d-fc8cae448933 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9342796ec00a4004be5d853d307a2411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbbbaba86b74b2184637e1cf58ec643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:09.555152 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-c2b2e0ff-565d-455f-b68d-fc8cae448933 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7" status: 200 len: 1313 microversion: 2.1 time: 0.228995 Oct 28 12:33:09.555737 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 222/430] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:09 2021] GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:10.096235 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-c7f815d5-1838-4d90-9da0-ebb10c451623 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:10.097258 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-c7f815d5-1838-4d90-9da0-ebb10c451623 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:10.110308 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c7f815d5-1838-4d90-9da0-ebb10c451623 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:10.111106 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c7f815d5-1838-4d90-9da0-ebb10c451623 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:10.112089 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c7f815d5-1838-4d90-9da0-ebb10c451623 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:10.112702 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c7f815d5-1838-4d90-9da0-ebb10c451623 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:10.162807 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-c7f815d5-1838-4d90-9da0-ebb10c451623 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076371 Oct 28 12:33:10.163733 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 209/431] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Oct 28 12:33:10 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:33:10.215359 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-830e3e67-0734-4d4a-b92f-af4b486e8e8d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:10.216027 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-830e3e67-0734-4d4a-b92f-af4b486e8e8d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:10.223223 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-830e3e67-0734-4d4a-b92f-af4b486e8e8d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:10.224607 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-830e3e67-0734-4d4a-b92f-af4b486e8e8d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:10.224607 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-830e3e67-0734-4d4a-b92f-af4b486e8e8d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:10.224930 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-830e3e67-0734-4d4a-b92f-af4b486e8e8d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:10.379860 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-830e3e67-0734-4d4a-b92f-af4b486e8e8d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:10.395373 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-830e3e67-0734-4d4a-b92f-af4b486e8e8d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:10.395373 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-830e3e67-0734-4d4a-b92f-af4b486e8e8d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:10.395373 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-830e3e67-0734-4d4a-b92f-af4b486e8e8d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1740 microversion: 2.20 time: 0.181103 Oct 28 12:33:10.403474 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 223/432] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:10 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:10.573428 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-d5cb774b-54be-4901-9dc0-430237dcb02e tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:10.574376 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-d5cb774b-54be-4901-9dc0-430237dcb02e tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 2d2cccc7-6745-4322-9f87-e556cff9f2f7] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:10.580920 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d5cb774b-54be-4901-9dc0-430237dcb02e tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:10.581433 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d5cb774b-54be-4901-9dc0-430237dcb02e tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:10.582302 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d5cb774b-54be-4901-9dc0-430237dcb02e tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:10.582847 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d5cb774b-54be-4901-9dc0-430237dcb02e tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:10.730180 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-d5cb774b-54be-4901-9dc0-430237dcb02e tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9342796ec00a4004be5d853d307a2411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbbbaba86b74b2184637e1cf58ec643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:10.738112 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-d5cb774b-54be-4901-9dc0-430237dcb02e tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7" status: 200 len: 1497 microversion: 2.1 time: 0.168588 Oct 28 12:33:10.740798 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 210/433] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:10 2021] GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7 => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:11.175831 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-2a72fe70-9814-47c7-b392-ede53665b154 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:11.176780 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-2a72fe70-9814-47c7-b392-ede53665b154 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:11.183754 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2a72fe70-9814-47c7-b392-ede53665b154 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:11.184196 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2a72fe70-9814-47c7-b392-ede53665b154 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:11.185002 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2a72fe70-9814-47c7-b392-ede53665b154 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:11.185433 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2a72fe70-9814-47c7-b392-ede53665b154 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:11.217412 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-2a72fe70-9814-47c7-b392-ede53665b154 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045583 Oct 28 12:33:11.218118 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 224/434] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Oct 28 12:33:11 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:33:11.369471 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-cc1b5836-093f-4d97-8fb2-a729711c8970 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:11.370041 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-cc1b5836-093f-4d97-8fb2-a729711c8970 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 2d2cccc7-6745-4322-9f87-e556cff9f2f7] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:11.376518 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cc1b5836-093f-4d97-8fb2-a729711c8970 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:11.377018 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cc1b5836-093f-4d97-8fb2-a729711c8970 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:11.377776 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cc1b5836-093f-4d97-8fb2-a729711c8970 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:11.378198 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cc1b5836-093f-4d97-8fb2-a729711c8970 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:11.402852 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-cc1b5836-093f-4d97-8fb2-a729711c8970 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 2d2cccc7-6745-4322-9f87-e556cff9f2f7] Going to try to terminate instance {{(pid=115876) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:33:11.410199 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-8979ce31-d03b-4761-9771-f4fd12691c18 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:11.410809 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-8979ce31-d03b-4761-9771-f4fd12691c18 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:11.417125 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8979ce31-d03b-4761-9771-f4fd12691c18 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:11.417560 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8979ce31-d03b-4761-9771-f4fd12691c18 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:11.418334 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8979ce31-d03b-4761-9771-f4fd12691c18 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:11.418772 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8979ce31-d03b-4761-9771-f4fd12691c18 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:11.498646 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-cc1b5836-093f-4d97-8fb2-a729711c8970 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "DELETE /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7" status: 204 len: 0 microversion: 2.1 time: 0.132233 Oct 28 12:33:11.499809 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 211/435] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Oct 28 12:33:11 2021] DELETE /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:33:11.507892 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-3f5bb62c-b476-4f48-8560-5f1754594bcb tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:11.508660 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-3f5bb62c-b476-4f48-8560-5f1754594bcb tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 2d2cccc7-6745-4322-9f87-e556cff9f2f7] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:11.515673 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3f5bb62c-b476-4f48-8560-5f1754594bcb tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:11.516180 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3f5bb62c-b476-4f48-8560-5f1754594bcb tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:11.517062 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3f5bb62c-b476-4f48-8560-5f1754594bcb tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:11.517555 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3f5bb62c-b476-4f48-8560-5f1754594bcb tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:11.580319 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-8979ce31-d03b-4761-9771-f4fd12691c18 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:11.593028 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-8979ce31-d03b-4761-9771-f4fd12691c18 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:11.594771 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-8979ce31-d03b-4761-9771-f4fd12691c18 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:11.596050 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-8979ce31-d03b-4761-9771-f4fd12691c18 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1740 microversion: 2.20 time: 0.189657 Oct 28 12:33:11.596611 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 225/436] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:11 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:11.678486 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-3f5bb62c-b476-4f48-8560-5f1754594bcb tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9342796ec00a4004be5d853d307a2411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbbbaba86b74b2184637e1cf58ec643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:11.687668 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-3f5bb62c-b476-4f48-8560-5f1754594bcb tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7" status: 200 len: 1503 microversion: 2.1 time: 0.182600 Oct 28 12:33:11.688603 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 212/437] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:11 2021] GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7 => generated 1503 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:33:12.232410 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-d4917a75-421a-47e9-98f6-89d34cfc332a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:12.233697 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-d4917a75-421a-47e9-98f6-89d34cfc332a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:12.242612 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d4917a75-421a-47e9-98f6-89d34cfc332a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:12.243945 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d4917a75-421a-47e9-98f6-89d34cfc332a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:12.244470 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d4917a75-421a-47e9-98f6-89d34cfc332a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:12.245132 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d4917a75-421a-47e9-98f6-89d34cfc332a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:12.278016 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-d4917a75-421a-47e9-98f6-89d34cfc332a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051183 Oct 28 12:33:12.278563 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 226/438] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Oct 28 12:33:12 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:33:12.616467 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-412091c7-2daa-4de7-94f9-ba134ef8bc27 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:12.617149 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-412091c7-2daa-4de7-94f9-ba134ef8bc27 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:12.625372 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-412091c7-2daa-4de7-94f9-ba134ef8bc27 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:12.625914 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-412091c7-2daa-4de7-94f9-ba134ef8bc27 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:12.626850 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-412091c7-2daa-4de7-94f9-ba134ef8bc27 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:12.627374 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-412091c7-2daa-4de7-94f9-ba134ef8bc27 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:12.707402 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-006c84d9-0e31-4bd8-b3d4-a32bf6210f08 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:12.708144 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-006c84d9-0e31-4bd8-b3d4-a32bf6210f08 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 2d2cccc7-6745-4322-9f87-e556cff9f2f7] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:12.717021 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-006c84d9-0e31-4bd8-b3d4-a32bf6210f08 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:12.717144 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-006c84d9-0e31-4bd8-b3d4-a32bf6210f08 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:12.717802 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-006c84d9-0e31-4bd8-b3d4-a32bf6210f08 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:12.718826 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-006c84d9-0e31-4bd8-b3d4-a32bf6210f08 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:12.770079 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-412091c7-2daa-4de7-94f9-ba134ef8bc27 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:12.777904 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-412091c7-2daa-4de7-94f9-ba134ef8bc27 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:12.779372 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-412091c7-2daa-4de7-94f9-ba134ef8bc27 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:12.780518 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-412091c7-2daa-4de7-94f9-ba134ef8bc27 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1722 microversion: 2.20 time: 0.168957 Oct 28 12:33:12.781170 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 213/439] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:12 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:12.849901 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-006c84d9-0e31-4bd8-b3d4-a32bf6210f08 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9342796ec00a4004be5d853d307a2411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbbbaba86b74b2184637e1cf58ec643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:12.858222 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-006c84d9-0e31-4bd8-b3d4-a32bf6210f08 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7" status: 200 len: 1503 microversion: 2.1 time: 0.156468 Oct 28 12:33:12.858804 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 227/440] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:12 2021] GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:33:13.799434 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-f2b47b35-14b2-4930-8c06-25efc4ccb8c0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:13.799984 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-f2b47b35-14b2-4930-8c06-25efc4ccb8c0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:13.807147 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f2b47b35-14b2-4930-8c06-25efc4ccb8c0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:13.807919 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f2b47b35-14b2-4930-8c06-25efc4ccb8c0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:13.808842 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f2b47b35-14b2-4930-8c06-25efc4ccb8c0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:13.809313 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f2b47b35-14b2-4930-8c06-25efc4ccb8c0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:13.875327 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-819f5aa4-429a-47d7-9bf1-123d0318b4b3 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:13.875932 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-819f5aa4-429a-47d7-9bf1-123d0318b4b3 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 2d2cccc7-6745-4322-9f87-e556cff9f2f7] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:13.882217 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-819f5aa4-429a-47d7-9bf1-123d0318b4b3 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:13.882631 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-819f5aa4-429a-47d7-9bf1-123d0318b4b3 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:13.883560 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-819f5aa4-429a-47d7-9bf1-123d0318b4b3 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:13.883967 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-819f5aa4-429a-47d7-9bf1-123d0318b4b3 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:13.964829 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f2b47b35-14b2-4930-8c06-25efc4ccb8c0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:13.973218 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f2b47b35-14b2-4930-8c06-25efc4ccb8c0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:13.974957 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f2b47b35-14b2-4930-8c06-25efc4ccb8c0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:13.976074 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-f2b47b35-14b2-4930-8c06-25efc4ccb8c0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1722 microversion: 2.20 time: 0.180501 Oct 28 12:33:13.976636 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 214/441] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:13 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:14.024093 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-819f5aa4-429a-47d7-9bf1-123d0318b4b3 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9342796ec00a4004be5d853d307a2411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbbbaba86b74b2184637e1cf58ec643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:14.031375 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-819f5aa4-429a-47d7-9bf1-123d0318b4b3 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7" status: 200 len: 1503 microversion: 2.1 time: 0.159823 Oct 28 12:33:14.031956 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 228/442] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:13 2021] GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:14.997733 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-c88ad314-bfdf-43ee-970b-2298a1250a8f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:14.998455 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-c88ad314-bfdf-43ee-970b-2298a1250a8f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:15.006109 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c88ad314-bfdf-43ee-970b-2298a1250a8f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:15.006548 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c88ad314-bfdf-43ee-970b-2298a1250a8f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:15.007307 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c88ad314-bfdf-43ee-970b-2298a1250a8f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:15.007733 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c88ad314-bfdf-43ee-970b-2298a1250a8f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:15.049079 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-1f2d9443-070c-4631-843b-260b1260da82 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:15.049647 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-1f2d9443-070c-4631-843b-260b1260da82 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 2d2cccc7-6745-4322-9f87-e556cff9f2f7] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:15.056074 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1f2d9443-070c-4631-843b-260b1260da82 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:15.056512 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1f2d9443-070c-4631-843b-260b1260da82 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:15.057332 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1f2d9443-070c-4631-843b-260b1260da82 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:15.058131 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1f2d9443-070c-4631-843b-260b1260da82 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:15.444978 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-c88ad314-bfdf-43ee-970b-2298a1250a8f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:15.457510 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-c88ad314-bfdf-43ee-970b-2298a1250a8f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:15.459546 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-c88ad314-bfdf-43ee-970b-2298a1250a8f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:15.461417 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-c88ad314-bfdf-43ee-970b-2298a1250a8f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1722 microversion: 2.20 time: 0.469986 Oct 28 12:33:15.461988 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 215/443] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:14 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1722 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:15.466983 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-6c5299f1-2818-4d49-a2f4-78257868f119 req-4c47693b-8395-4403-b9ea-670806bf054c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6a3a830-8175-434e-8c23-336ccacf7ef8", "name": "network-vif-unplugged", "status": "completed", "tag": "fd7216a9-4fe8-4770-a641-9f1115f86217"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:33:15.468643 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:33:15.468643 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:33:15.476144 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-6c5299f1-2818-4d49-a2f4-78257868f119 req-4c47693b-8395-4403-b9ea-670806bf054c service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:15.476639 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-6c5299f1-2818-4d49-a2f4-78257868f119 req-4c47693b-8395-4403-b9ea-670806bf054c service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:15.488679 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-6c5299f1-2818-4d49-a2f4-78257868f119 req-4c47693b-8395-4403-b9ea-670806bf054c service nova] Creating event network-vif-unplugged:fd7216a9-4fe8-4770-a641-9f1115f86217 for instance f6a3a830-8175-434e-8c23-336ccacf7ef8 on hv-cinder-81514 Oct 28 12:33:15.493937 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-6c5299f1-2818-4d49-a2f4-78257868f119 req-4c47693b-8395-4403-b9ea-670806bf054c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030298 Oct 28 12:33:15.494714 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 216/444] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:33:15 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:33:15.511250 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-1f2d9443-070c-4631-843b-260b1260da82 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9342796ec00a4004be5d853d307a2411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbbbaba86b74b2184637e1cf58ec643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:15.519006 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-1f2d9443-070c-4631-843b-260b1260da82 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7" status: 200 len: 1503 microversion: 2.1 time: 0.473658 Oct 28 12:33:15.519598 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 229/445] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:15 2021] GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7 => generated 1503 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:16.484913 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-636d0faa-2aff-40f6-89b1-3a879c5d73a6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:16.486138 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-636d0faa-2aff-40f6-89b1-3a879c5d73a6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:16.496661 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-636d0faa-2aff-40f6-89b1-3a879c5d73a6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:16.497444 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-636d0faa-2aff-40f6-89b1-3a879c5d73a6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:16.498688 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-636d0faa-2aff-40f6-89b1-3a879c5d73a6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:16.499397 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-636d0faa-2aff-40f6-89b1-3a879c5d73a6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:16.535962 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-a4a84df9-96e9-4778-a8a7-8a9d97d365b7 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:16.536551 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-a4a84df9-96e9-4778-a8a7-8a9d97d365b7 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 2d2cccc7-6745-4322-9f87-e556cff9f2f7] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:16.543133 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a4a84df9-96e9-4778-a8a7-8a9d97d365b7 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:16.543579 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a4a84df9-96e9-4778-a8a7-8a9d97d365b7 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:16.544360 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a4a84df9-96e9-4778-a8a7-8a9d97d365b7 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:16.544858 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a4a84df9-96e9-4778-a8a7-8a9d97d365b7 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:16.653539 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-636d0faa-2aff-40f6-89b1-3a879c5d73a6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:16.662045 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-636d0faa-2aff-40f6-89b1-3a879c5d73a6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:16.663550 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-636d0faa-2aff-40f6-89b1-3a879c5d73a6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:16.664869 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-636d0faa-2aff-40f6-89b1-3a879c5d73a6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1722 microversion: 2.20 time: 0.187493 Oct 28 12:33:16.665382 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 217/446] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:16 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:16.707565 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-a4a84df9-96e9-4778-a8a7-8a9d97d365b7 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9342796ec00a4004be5d853d307a2411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbbbaba86b74b2184637e1cf58ec643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:16.715517 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-a4a84df9-96e9-4778-a8a7-8a9d97d365b7 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7" status: 200 len: 1503 microversion: 2.1 time: 0.183208 Oct 28 12:33:16.716512 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 230/447] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:16 2021] GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7 => generated 1503 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:17.683661 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-e95c37ae-eccc-4aee-b996-c4d021cfe27d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:17.684235 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-e95c37ae-eccc-4aee-b996-c4d021cfe27d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:17.691114 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e95c37ae-eccc-4aee-b996-c4d021cfe27d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:17.691559 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e95c37ae-eccc-4aee-b996-c4d021cfe27d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:17.692328 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e95c37ae-eccc-4aee-b996-c4d021cfe27d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:17.692756 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e95c37ae-eccc-4aee-b996-c4d021cfe27d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:17.733405 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-41759117-5c83-4c0f-82a7-a43c602def5d tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:17.734115 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-41759117-5c83-4c0f-82a7-a43c602def5d tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 2d2cccc7-6745-4322-9f87-e556cff9f2f7] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:17.740705 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-41759117-5c83-4c0f-82a7-a43c602def5d tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:17.741171 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-41759117-5c83-4c0f-82a7-a43c602def5d tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:17.741939 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-41759117-5c83-4c0f-82a7-a43c602def5d tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:17.742361 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-41759117-5c83-4c0f-82a7-a43c602def5d tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:17.845784 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-e95c37ae-eccc-4aee-b996-c4d021cfe27d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:17.854139 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-e95c37ae-eccc-4aee-b996-c4d021cfe27d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:17.855594 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-e95c37ae-eccc-4aee-b996-c4d021cfe27d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:17.856746 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-e95c37ae-eccc-4aee-b996-c4d021cfe27d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1722 microversion: 2.20 time: 0.177252 Oct 28 12:33:17.857330 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 218/448] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:17 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:17.895812 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-41759117-5c83-4c0f-82a7-a43c602def5d tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9342796ec00a4004be5d853d307a2411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbbbaba86b74b2184637e1cf58ec643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:17.907704 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-41759117-5c83-4c0f-82a7-a43c602def5d tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7" status: 200 len: 1503 microversion: 2.1 time: 0.177508 Oct 28 12:33:17.909072 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 231/449] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:17 2021] GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7 => generated 1503 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:18.876361 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-21dd5e8f-754f-4d02-aa04-271860d1e954 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:18.876985 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-21dd5e8f-754f-4d02-aa04-271860d1e954 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:18.883850 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-21dd5e8f-754f-4d02-aa04-271860d1e954 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:18.884285 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-21dd5e8f-754f-4d02-aa04-271860d1e954 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:18.885056 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-21dd5e8f-754f-4d02-aa04-271860d1e954 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:18.885485 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-21dd5e8f-754f-4d02-aa04-271860d1e954 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:18.929739 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-2432dd0a-fc52-4590-ace0-f79da98ca3f9 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:18.930341 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-2432dd0a-fc52-4590-ace0-f79da98ca3f9 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 2d2cccc7-6745-4322-9f87-e556cff9f2f7] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:18.937217 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2432dd0a-fc52-4590-ace0-f79da98ca3f9 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:18.937878 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2432dd0a-fc52-4590-ace0-f79da98ca3f9 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:18.938700 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2432dd0a-fc52-4590-ace0-f79da98ca3f9 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:18.939133 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2432dd0a-fc52-4590-ace0-f79da98ca3f9 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:19.041762 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-21dd5e8f-754f-4d02-aa04-271860d1e954 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:19.049936 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-21dd5e8f-754f-4d02-aa04-271860d1e954 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:19.051427 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-21dd5e8f-754f-4d02-aa04-271860d1e954 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:19.052549 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-21dd5e8f-754f-4d02-aa04-271860d1e954 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1722 microversion: 2.20 time: 0.179979 Oct 28 12:33:19.053189 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 219/450] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:18 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:19.096553 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-2432dd0a-fc52-4590-ace0-f79da98ca3f9 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9342796ec00a4004be5d853d307a2411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbbbaba86b74b2184637e1cf58ec643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:19.104409 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-2432dd0a-fc52-4590-ace0-f79da98ca3f9 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7" status: 200 len: 1503 microversion: 2.1 time: 0.179549 Oct 28 12:33:19.105008 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 232/451] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:18 2021] GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7 => generated 1503 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:19.863420 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-95f2ab19-a575-4f18-9548-d01c33ac5a87 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:19.864246 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-95f2ab19-a575-4f18-9548-d01c33ac5a87 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:19.870536 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-95f2ab19-a575-4f18-9548-d01c33ac5a87 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:19.871257 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-95f2ab19-a575-4f18-9548-d01c33ac5a87 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:19.872110 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-95f2ab19-a575-4f18-9548-d01c33ac5a87 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:19.872608 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-95f2ab19-a575-4f18-9548-d01c33ac5a87 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:19.900516 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-95f2ab19-a575-4f18-9548-d01c33ac5a87 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Going to try to terminate instance {{(pid=115876) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:33:19.946098 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-a0ef7e27-680c-49b4-8104-bec871459589 req-bd7d745a-274b-4b25-97b9-a2927784b963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d2cccc7-6745-4322-9f87-e556cff9f2f7", "name": "network-vif-deleted", "tag": "3bac65dc-2a0c-40dd-a1b2-568bc53579bf"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:33:19.948527 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:33:19.948527 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:33:19.956979 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-a0ef7e27-680c-49b4-8104-bec871459589 req-bd7d745a-274b-4b25-97b9-a2927784b963 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:19.957444 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-a0ef7e27-680c-49b4-8104-bec871459589 req-bd7d745a-274b-4b25-97b9-a2927784b963 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:19.970535 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-a0ef7e27-680c-49b4-8104-bec871459589 req-bd7d745a-274b-4b25-97b9-a2927784b963 service nova] Creating event network-vif-deleted:3bac65dc-2a0c-40dd-a1b2-568bc53579bf for instance 2d2cccc7-6745-4322-9f87-e556cff9f2f7 on hv-cinder-81514 Oct 28 12:33:19.977242 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-a0ef7e27-680c-49b4-8104-bec871459589 req-bd7d745a-274b-4b25-97b9-a2927784b963 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035312 Oct 28 12:33:19.977910 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 233/452] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:33:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:33:19.981907 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-95f2ab19-a575-4f18-9548-d01c33ac5a87 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 204 len: 0 microversion: 2.1 time: 0.121863 Oct 28 12:33:19.982491 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 220/453] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Oct 28 12:33:19 2021] DELETE /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:33:19.991365 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-2bc62138-6569-4158-bfc8-97359d11881c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:19.992370 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-2bc62138-6569-4158-bfc8-97359d11881c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:19.999101 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2bc62138-6569-4158-bfc8-97359d11881c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:19.999796 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2bc62138-6569-4158-bfc8-97359d11881c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:20.000872 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2bc62138-6569-4158-bfc8-97359d11881c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:20.001377 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2bc62138-6569-4158-bfc8-97359d11881c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:20.072403 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-f2771e13-7061-45bd-9d14-dff19205f3c8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:20.073027 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-f2771e13-7061-45bd-9d14-dff19205f3c8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:20.078932 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f2771e13-7061-45bd-9d14-dff19205f3c8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:20.079365 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f2771e13-7061-45bd-9d14-dff19205f3c8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:20.080139 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f2771e13-7061-45bd-9d14-dff19205f3c8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:20.080539 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f2771e13-7061-45bd-9d14-dff19205f3c8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:20.167246 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-2bc62138-6569-4158-bfc8-97359d11881c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:20.177625 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-2bc62138-6569-4158-bfc8-97359d11881c tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1508 microversion: 2.1 time: 0.190320 Oct 28 12:33:20.178919 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 234/454] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:19 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1508 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:33:20.184509 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-27d289b0-5208-4d42-aabb-c0cc2ceb81df tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:20.185465 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-27d289b0-5208-4d42-aabb-c0cc2ceb81df tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 2d2cccc7-6745-4322-9f87-e556cff9f2f7] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:20.194625 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-27d289b0-5208-4d42-aabb-c0cc2ceb81df tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:20.195508 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-27d289b0-5208-4d42-aabb-c0cc2ceb81df tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:20.196498 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-27d289b0-5208-4d42-aabb-c0cc2ceb81df tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:20.197113 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-27d289b0-5208-4d42-aabb-c0cc2ceb81df tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:20.233698 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-27d289b0-5208-4d42-aabb-c0cc2ceb81df tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:20.234485 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-27d289b0-5208-4d42-aabb-c0cc2ceb81df tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:20.234932 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.objects.instance [None req-27d289b0-5208-4d42-aabb-c0cc2ceb81df tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lazy-loading 'fault' on Instance uuid 2d2cccc7-6745-4322-9f87-e556cff9f2f7 {{(pid=115877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:33:20.236420 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f2771e13-7061-45bd-9d14-dff19205f3c8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:20.245787 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f2771e13-7061-45bd-9d14-dff19205f3c8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:20.247786 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f2771e13-7061-45bd-9d14-dff19205f3c8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:20.249786 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-f2771e13-7061-45bd-9d14-dff19205f3c8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1725 microversion: 2.20 time: 0.181925 Oct 28 12:33:20.262720 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 221/455] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:20 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:20.268571 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-73a439f4-e706-45c0-808e-623c75c92e4f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5299c6e5-4f51-4a0f-9b3b-eb71927bd18b"}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:33:20.271998 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-73a439f4-e706-45c0-808e-623c75c92e4f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:20.281395 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-27d289b0-5208-4d42-aabb-c0cc2ceb81df tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9342796ec00a4004be5d853d307a2411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbbbaba86b74b2184637e1cf58ec643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:20.289346 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-73a439f4-e706-45c0-808e-623c75c92e4f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:20.291226 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-27d289b0-5208-4d42-aabb-c0cc2ceb81df tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7" status: 200 len: 1303 microversion: 2.1 time: 0.111006 Oct 28 12:33:20.291813 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 235/456] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:20 2021] GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7 => generated 1303 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:20.300890 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-73a439f4-e706-45c0-808e-623c75c92e4f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:20.302105 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-73a439f4-e706-45c0-808e-623c75c92e4f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:20.302585 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-73a439f4-e706-45c0-808e-623c75c92e4f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:20.594344 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-73a439f4-e706-45c0-808e-623c75c92e4f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.329787 Oct 28 12:33:20.594947 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 222/457] 10.222.0.62 () {62 vars in 1363 bytes} [Thu Oct 28 12:33:20 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/os-volume_attachments => generated 188 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:33:20.717137 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-00b91af2-a81f-4911-aefd-fbd384e94298 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:33:20.717701 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-00b91af2-a81f-4911-aefd-fbd384e94298 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:20.724172 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-00b91af2-a81f-4911-aefd-fbd384e94298 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:20.724626 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-00b91af2-a81f-4911-aefd-fbd384e94298 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:20.725469 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-00b91af2-a81f-4911-aefd-fbd384e94298 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:20.725900 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-00b91af2-a81f-4911-aefd-fbd384e94298 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:20.822093 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-00b91af2-a81f-4911-aefd-fbd384e94298 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action" status: 202 len: 0 microversion: 2.20 time: 0.109054 Oct 28 12:33:20.822696 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 236/458] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:33:20 2021] POST /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:33:20.830852 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-47b68f7b-2713-451a-b778-c53e8a388c40 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:20.831447 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-47b68f7b-2713-451a-b778-c53e8a388c40 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:20.838292 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-47b68f7b-2713-451a-b778-c53e8a388c40 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:20.838725 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-47b68f7b-2713-451a-b778-c53e8a388c40 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:20.839643 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-47b68f7b-2713-451a-b778-c53e8a388c40 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:20.840065 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-47b68f7b-2713-451a-b778-c53e8a388c40 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:20.965768 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-47b68f7b-2713-451a-b778-c53e8a388c40 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:20.974154 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-47b68f7b-2713-451a-b778-c53e8a388c40 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:20.975727 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-47b68f7b-2713-451a-b778-c53e8a388c40 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:20.976918 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-47b68f7b-2713-451a-b778-c53e8a388c40 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1751 microversion: 2.20 time: 0.149922 Oct 28 12:33:20.977741 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 223/459] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:20 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1751 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:33:21.196518 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-ca068fef-86e4-4654-8286-e98202d6cd9f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:21.197184 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-ca068fef-86e4-4654-8286-e98202d6cd9f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:21.204096 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ca068fef-86e4-4654-8286-e98202d6cd9f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:21.204532 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ca068fef-86e4-4654-8286-e98202d6cd9f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:21.205437 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ca068fef-86e4-4654-8286-e98202d6cd9f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:21.205924 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ca068fef-86e4-4654-8286-e98202d6cd9f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:21.307962 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-7544b766-93c9-4048-b601-84c67c251d36 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:21.308592 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-7544b766-93c9-4048-b601-84c67c251d36 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 2d2cccc7-6745-4322-9f87-e556cff9f2f7] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:21.314615 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7544b766-93c9-4048-b601-84c67c251d36 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:21.315129 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7544b766-93c9-4048-b601-84c67c251d36 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:21.315921 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7544b766-93c9-4048-b601-84c67c251d36 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:21.316336 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7544b766-93c9-4048-b601-84c67c251d36 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:21.348735 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7544b766-93c9-4048-b601-84c67c251d36 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:21.349726 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7544b766-93c9-4048-b601-84c67c251d36 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:21.354077 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.objects.instance [None req-7544b766-93c9-4048-b601-84c67c251d36 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lazy-loading 'fault' on Instance uuid 2d2cccc7-6745-4322-9f87-e556cff9f2f7 {{(pid=115876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:33:21.361569 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-ca068fef-86e4-4654-8286-e98202d6cd9f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:21.369418 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-ca068fef-86e4-4654-8286-e98202d6cd9f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1508 microversion: 2.1 time: 0.177774 Oct 28 12:33:21.369971 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 237/460] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:21 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1508 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:21.398558 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-7544b766-93c9-4048-b601-84c67c251d36 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9342796ec00a4004be5d853d307a2411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbbbaba86b74b2184637e1cf58ec643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:21.406133 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-7544b766-93c9-4048-b601-84c67c251d36 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7" status: 200 len: 1303 microversion: 2.1 time: 0.102431 Oct 28 12:33:21.406716 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 224/461] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:21 2021] GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7 => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:21.996178 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-fc3e6a36-371c-4941-96ca-87faade6bc02 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:21.996767 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-fc3e6a36-371c-4941-96ca-87faade6bc02 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:22.003267 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fc3e6a36-371c-4941-96ca-87faade6bc02 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:22.003788 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fc3e6a36-371c-4941-96ca-87faade6bc02 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:22.004703 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fc3e6a36-371c-4941-96ca-87faade6bc02 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:22.005303 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fc3e6a36-371c-4941-96ca-87faade6bc02 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:22.154993 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-fc3e6a36-371c-4941-96ca-87faade6bc02 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:22.165729 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-fc3e6a36-371c-4941-96ca-87faade6bc02 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:22.167260 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-fc3e6a36-371c-4941-96ca-87faade6bc02 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:22.168420 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-fc3e6a36-371c-4941-96ca-87faade6bc02 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1751 microversion: 2.20 time: 0.176037 Oct 28 12:33:22.169036 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 238/462] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:21 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1751 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:22.390154 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-07982006-9db5-4643-8c89-eddba61b32e7 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:22.390712 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-07982006-9db5-4643-8c89-eddba61b32e7 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:22.401978 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-07982006-9db5-4643-8c89-eddba61b32e7 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:22.402411 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-07982006-9db5-4643-8c89-eddba61b32e7 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:22.403166 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-07982006-9db5-4643-8c89-eddba61b32e7 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:22.403574 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-07982006-9db5-4643-8c89-eddba61b32e7 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:22.422944 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-8b09217f-4ad3-4bd7-a04b-85a4e88fdb79 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:22.423699 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-8b09217f-4ad3-4bd7-a04b-85a4e88fdb79 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 2d2cccc7-6745-4322-9f87-e556cff9f2f7] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:22.430682 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8b09217f-4ad3-4bd7-a04b-85a4e88fdb79 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:22.431199 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8b09217f-4ad3-4bd7-a04b-85a4e88fdb79 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:22.432154 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8b09217f-4ad3-4bd7-a04b-85a4e88fdb79 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:22.433120 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8b09217f-4ad3-4bd7-a04b-85a4e88fdb79 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:22.465459 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8b09217f-4ad3-4bd7-a04b-85a4e88fdb79 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:22.465882 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8b09217f-4ad3-4bd7-a04b-85a4e88fdb79 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:22.466316 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.objects.instance [None req-8b09217f-4ad3-4bd7-a04b-85a4e88fdb79 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lazy-loading 'fault' on Instance uuid 2d2cccc7-6745-4322-9f87-e556cff9f2f7 {{(pid=115877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:33:22.526224 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-8b09217f-4ad3-4bd7-a04b-85a4e88fdb79 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9342796ec00a4004be5d853d307a2411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fbbbaba86b74b2184637e1cf58ec643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:22.534067 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-8b09217f-4ad3-4bd7-a04b-85a4e88fdb79 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7" status: 200 len: 1303 microversion: 2.1 time: 0.114803 Oct 28 12:33:22.534635 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 239/463] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:22 2021] GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7 => generated 1303 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:22.558018 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-07982006-9db5-4643-8c89-eddba61b32e7 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:22.565780 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-07982006-9db5-4643-8c89-eddba61b32e7 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1508 microversion: 2.1 time: 0.183089 Oct 28 12:33:22.566349 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 225/464] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:22 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1508 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:23.187427 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-f88972f5-4fc6-4704-893a-ee674f0dc35f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:23.188016 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-f88972f5-4fc6-4704-893a-ee674f0dc35f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:23.194648 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f88972f5-4fc6-4704-893a-ee674f0dc35f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:23.195097 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f88972f5-4fc6-4704-893a-ee674f0dc35f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:23.195883 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f88972f5-4fc6-4704-893a-ee674f0dc35f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:23.196328 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f88972f5-4fc6-4704-893a-ee674f0dc35f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:23.337327 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-f88972f5-4fc6-4704-893a-ee674f0dc35f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:23.346075 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-f88972f5-4fc6-4704-893a-ee674f0dc35f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:23.347648 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-f88972f5-4fc6-4704-893a-ee674f0dc35f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:23.348809 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-f88972f5-4fc6-4704-893a-ee674f0dc35f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1751 microversion: 2.20 time: 0.165164 Oct 28 12:33:23.349364 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 240/465] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:23 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:23.561402 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-9550870e-4355-47c8-bf6e-a0faac87f526 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:23.562206 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-9550870e-4355-47c8-bf6e-a0faac87f526 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] [instance: 2d2cccc7-6745-4322-9f87-e556cff9f2f7] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:23.571643 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9550870e-4355-47c8-bf6e-a0faac87f526 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:23.572180 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9550870e-4355-47c8-bf6e-a0faac87f526 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:23.573409 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9550870e-4355-47c8-bf6e-a0faac87f526 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:23.573952 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9550870e-4355-47c8-bf6e-a0faac87f526 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:23.583017 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-5d629616-f36a-4268-abe6-50e576cc0f8a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:23.583587 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-5d629616-f36a-4268-abe6-50e576cc0f8a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:23.589106 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.wsgi [None req-9550870e-4355-47c8-bf6e-a0faac87f526 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] HTTP exception thrown: Instance 2d2cccc7-6745-4322-9f87-e556cff9f2f7 could not be found. Oct 28 12:33:23.589680 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-9550870e-4355-47c8-bf6e-a0faac87f526 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] Returning 404 to user: Instance 2d2cccc7-6745-4322-9f87-e556cff9f2f7 could not be found. {{(pid=115876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:33:23.590511 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-9550870e-4355-47c8-bf6e-a0faac87f526 tempest-VolumesActionsTest-119836886 tempest-VolumesActionsTest-119836886-project] 10.222.0.62 "GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7" status: 404 len: 111 microversion: 2.1 time: 0.042699 Oct 28 12:33:23.591370 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 226/466] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:23 2021] GET /compute/v2.1/servers/2d2cccc7-6745-4322-9f87-e556cff9f2f7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:33:23.591548 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5d629616-f36a-4268-abe6-50e576cc0f8a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:23.592002 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5d629616-f36a-4268-abe6-50e576cc0f8a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:23.592816 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5d629616-f36a-4268-abe6-50e576cc0f8a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:23.593243 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5d629616-f36a-4268-abe6-50e576cc0f8a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:23.742113 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-5d629616-f36a-4268-abe6-50e576cc0f8a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:23.749396 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-5d629616-f36a-4268-abe6-50e576cc0f8a tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1508 microversion: 2.1 time: 0.170372 Oct 28 12:33:23.750809 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 241/467] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:23 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:24.369506 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-e8c05e29-5898-4235-9643-1cdf22e61575 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:24.370126 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-e8c05e29-5898-4235-9643-1cdf22e61575 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:24.376799 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e8c05e29-5898-4235-9643-1cdf22e61575 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:24.377271 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e8c05e29-5898-4235-9643-1cdf22e61575 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:24.378094 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e8c05e29-5898-4235-9643-1cdf22e61575 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:24.378636 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e8c05e29-5898-4235-9643-1cdf22e61575 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:24.531779 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-e8c05e29-5898-4235-9643-1cdf22e61575 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:24.541169 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-e8c05e29-5898-4235-9643-1cdf22e61575 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:24.542722 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-e8c05e29-5898-4235-9643-1cdf22e61575 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:24.543891 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-e8c05e29-5898-4235-9643-1cdf22e61575 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1753 microversion: 2.20 time: 0.178261 Oct 28 12:33:24.544445 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 227/468] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:24 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1753 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:24.768625 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-c3c3f4d8-f11b-4bb0-b950-6b74ac5ce9fc tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:24.769707 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-c3c3f4d8-f11b-4bb0-b950-6b74ac5ce9fc tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:24.778843 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c3c3f4d8-f11b-4bb0-b950-6b74ac5ce9fc tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:24.779494 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c3c3f4d8-f11b-4bb0-b950-6b74ac5ce9fc tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:24.780663 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c3c3f4d8-f11b-4bb0-b950-6b74ac5ce9fc tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:24.781165 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c3c3f4d8-f11b-4bb0-b950-6b74ac5ce9fc tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:24.923236 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-c3c3f4d8-f11b-4bb0-b950-6b74ac5ce9fc tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:24.935987 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-c3c3f4d8-f11b-4bb0-b950-6b74ac5ce9fc tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1508 microversion: 2.1 time: 0.171152 Oct 28 12:33:24.937178 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 242/469] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:24 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:25.565866 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-e48ae77c-b91e-4bab-9c56-a6bb66ab8cab tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:25.566660 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-e48ae77c-b91e-4bab-9c56-a6bb66ab8cab tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:25.573630 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e48ae77c-b91e-4bab-9c56-a6bb66ab8cab tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:25.574072 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e48ae77c-b91e-4bab-9c56-a6bb66ab8cab tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:25.574916 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e48ae77c-b91e-4bab-9c56-a6bb66ab8cab tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:25.576306 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e48ae77c-b91e-4bab-9c56-a6bb66ab8cab tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:25.713428 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-e48ae77c-b91e-4bab-9c56-a6bb66ab8cab tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:25.725684 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-e48ae77c-b91e-4bab-9c56-a6bb66ab8cab tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:25.727158 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-e48ae77c-b91e-4bab-9c56-a6bb66ab8cab tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:25.728304 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-e48ae77c-b91e-4bab-9c56-a6bb66ab8cab tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1809 microversion: 2.20 time: 0.167042 Oct 28 12:33:25.728900 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 228/470] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:25 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:25.958610 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-b4f0d458-9b74-4693-98c5-0a6632d18336 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:25.959168 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-b4f0d458-9b74-4693-98c5-0a6632d18336 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:25.965865 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b4f0d458-9b74-4693-98c5-0a6632d18336 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:25.966301 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b4f0d458-9b74-4693-98c5-0a6632d18336 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:25.967055 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b4f0d458-9b74-4693-98c5-0a6632d18336 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:25.967476 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b4f0d458-9b74-4693-98c5-0a6632d18336 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:26.102204 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-b4f0d458-9b74-4693-98c5-0a6632d18336 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:26.110135 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-b4f0d458-9b74-4693-98c5-0a6632d18336 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1508 microversion: 2.1 time: 0.157575 Oct 28 12:33:26.110709 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 243/471] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:25 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:26.746812 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-f200ede9-19ac-43e0-a254-b75b64a53f9b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:26.747407 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-f200ede9-19ac-43e0-a254-b75b64a53f9b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:26.754248 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f200ede9-19ac-43e0-a254-b75b64a53f9b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:26.754680 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f200ede9-19ac-43e0-a254-b75b64a53f9b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:26.755423 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f200ede9-19ac-43e0-a254-b75b64a53f9b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:26.755838 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f200ede9-19ac-43e0-a254-b75b64a53f9b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:26.879880 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f200ede9-19ac-43e0-a254-b75b64a53f9b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:26.888281 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f200ede9-19ac-43e0-a254-b75b64a53f9b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:26.889805 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f200ede9-19ac-43e0-a254-b75b64a53f9b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:26.890987 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-f200ede9-19ac-43e0-a254-b75b64a53f9b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1809 microversion: 2.20 time: 0.148017 Oct 28 12:33:26.891575 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 229/472] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:26 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1809 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:27.131475 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-a2882ece-e484-4713-a16c-891118ad059d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:27.132019 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-a2882ece-e484-4713-a16c-891118ad059d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:27.138922 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a2882ece-e484-4713-a16c-891118ad059d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:27.139365 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a2882ece-e484-4713-a16c-891118ad059d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:27.140134 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a2882ece-e484-4713-a16c-891118ad059d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:27.140572 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a2882ece-e484-4713-a16c-891118ad059d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:27.276787 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-a2882ece-e484-4713-a16c-891118ad059d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:27.286636 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-a2882ece-e484-4713-a16c-891118ad059d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1508 microversion: 2.1 time: 0.160230 Oct 28 12:33:27.287358 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 244/473] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:27 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:27.909564 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-26edab5e-8466-40c5-86dd-79c36d91af48 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:27.910163 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-26edab5e-8466-40c5-86dd-79c36d91af48 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:27.917190 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-26edab5e-8466-40c5-86dd-79c36d91af48 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:27.917619 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-26edab5e-8466-40c5-86dd-79c36d91af48 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:27.918399 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-26edab5e-8466-40c5-86dd-79c36d91af48 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:27.918824 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-26edab5e-8466-40c5-86dd-79c36d91af48 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:28.098002 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-26edab5e-8466-40c5-86dd-79c36d91af48 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:28.107237 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-26edab5e-8466-40c5-86dd-79c36d91af48 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:28.108776 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-26edab5e-8466-40c5-86dd-79c36d91af48 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:28.109942 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-26edab5e-8466-40c5-86dd-79c36d91af48 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1809 microversion: 2.20 time: 0.204442 Oct 28 12:33:28.110595 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 230/474] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:27 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1809 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:28.309080 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-361ac811-ba30-42e4-821e-ad1ac426f347 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:28.309646 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-361ac811-ba30-42e4-821e-ad1ac426f347 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:28.316271 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-361ac811-ba30-42e4-821e-ad1ac426f347 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:28.316746 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-361ac811-ba30-42e4-821e-ad1ac426f347 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:28.317529 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-361ac811-ba30-42e4-821e-ad1ac426f347 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:28.317954 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-361ac811-ba30-42e4-821e-ad1ac426f347 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:28.446236 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-361ac811-ba30-42e4-821e-ad1ac426f347 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:28.455507 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-361ac811-ba30-42e4-821e-ad1ac426f347 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1508 microversion: 2.1 time: 0.150087 Oct 28 12:33:28.455507 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 245/475] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:28 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:29.127288 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-ad3b5b61-73d3-4e65-9f55-6e6ea34bafd7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:29.127883 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-ad3b5b61-73d3-4e65-9f55-6e6ea34bafd7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:29.135107 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ad3b5b61-73d3-4e65-9f55-6e6ea34bafd7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:29.135580 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ad3b5b61-73d3-4e65-9f55-6e6ea34bafd7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:29.136296 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ad3b5b61-73d3-4e65-9f55-6e6ea34bafd7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:29.145604 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ad3b5b61-73d3-4e65-9f55-6e6ea34bafd7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:29.328996 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-ad3b5b61-73d3-4e65-9f55-6e6ea34bafd7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:29.351921 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-ad3b5b61-73d3-4e65-9f55-6e6ea34bafd7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:29.353839 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-ad3b5b61-73d3-4e65-9f55-6e6ea34bafd7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:29.355711 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-ad3b5b61-73d3-4e65-9f55-6e6ea34bafd7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1809 microversion: 2.20 time: 0.232161 Oct 28 12:33:29.356308 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 231/476] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:29 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1809 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:33:29.476324 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-47687904-3777-4ab6-a5a1-9e557ee5ecc5 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:29.477110 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-47687904-3777-4ab6-a5a1-9e557ee5ecc5 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:29.491086 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-47687904-3777-4ab6-a5a1-9e557ee5ecc5 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:29.492683 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-47687904-3777-4ab6-a5a1-9e557ee5ecc5 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:29.495837 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-47687904-3777-4ab6-a5a1-9e557ee5ecc5 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:29.496570 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-47687904-3777-4ab6-a5a1-9e557ee5ecc5 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:29.641580 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-47687904-3777-4ab6-a5a1-9e557ee5ecc5 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:29.649744 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-47687904-3777-4ab6-a5a1-9e557ee5ecc5 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1508 microversion: 2.1 time: 0.179048 Oct 28 12:33:29.653102 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 246/477] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:29 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1508 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:30.383513 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-7d4933f9-f380-44fe-9b5c-d6ef1f0581e3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:30.385781 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-7d4933f9-f380-44fe-9b5c-d6ef1f0581e3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:30.404754 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7d4933f9-f380-44fe-9b5c-d6ef1f0581e3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:30.405786 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7d4933f9-f380-44fe-9b5c-d6ef1f0581e3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:30.406783 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7d4933f9-f380-44fe-9b5c-d6ef1f0581e3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:30.408508 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7d4933f9-f380-44fe-9b5c-d6ef1f0581e3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:30.671133 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-e573b572-3cef-414d-83c7-371ae3cf704e tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:30.672037 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-e573b572-3cef-414d-83c7-371ae3cf704e tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:30.686212 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e573b572-3cef-414d-83c7-371ae3cf704e tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:30.687336 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e573b572-3cef-414d-83c7-371ae3cf704e tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:30.689338 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-7d4933f9-f380-44fe-9b5c-d6ef1f0581e3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:30.690123 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e573b572-3cef-414d-83c7-371ae3cf704e tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:30.690639 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e573b572-3cef-414d-83c7-371ae3cf704e tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:30.700814 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-7d4933f9-f380-44fe-9b5c-d6ef1f0581e3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:30.702809 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-7d4933f9-f380-44fe-9b5c-d6ef1f0581e3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:30.704144 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-7d4933f9-f380-44fe-9b5c-d6ef1f0581e3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1809 microversion: 2.20 time: 0.332539 Oct 28 12:33:30.705025 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 232/478] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:30 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1809 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:30.913999 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-1e46756b-f0ac-4518-950a-74618f5d426d tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:30.914700 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-1e46756b-f0ac-4518-950a-74618f5d426d tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: e9dc74b0-0412-4f1d-ba9f-18c7b792df75] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:30.922400 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1e46756b-f0ac-4518-950a-74618f5d426d tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:30.923583 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1e46756b-f0ac-4518-950a-74618f5d426d tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:30.924961 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1e46756b-f0ac-4518-950a-74618f5d426d tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:30.925699 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1e46756b-f0ac-4518-950a-74618f5d426d tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:30.960809 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-e573b572-3cef-414d-83c7-371ae3cf704e tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:30.969647 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-e573b572-3cef-414d-83c7-371ae3cf704e tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1508 microversion: 2.1 time: 0.302584 Oct 28 12:33:30.979954 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 247/479] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:30 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1508 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:31.082319 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.objects.instance [None req-1e46756b-f0ac-4518-950a-74618f5d426d tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lazy-loading 'services' on Instance uuid e9dc74b0-0412-4f1d-ba9f-18c7b792df75 {{(pid=115876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:33:31.183483 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-1e46756b-f0ac-4518-950a-74618f5d426d tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75/os-volume_attachments/e0987204-b0c9-4c1c-b352-062d06f012c1" status: 202 len: 0 microversion: 2.1 time: 0.273637 Oct 28 12:33:31.185001 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 233/480] 10.222.0.62 () {58 vars in 1415 bytes} [Thu Oct 28 12:33:30 2021] DELETE /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75/os-volume_attachments/e0987204-b0c9-4c1c-b352-062d06f012c1 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:33:31.729391 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-58683312-4d74-42e2-a661-dab9e1efe64a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:31.730256 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-58683312-4d74-42e2-a661-dab9e1efe64a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:31.744824 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-58683312-4d74-42e2-a661-dab9e1efe64a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:31.745613 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-58683312-4d74-42e2-a661-dab9e1efe64a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:31.746684 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-58683312-4d74-42e2-a661-dab9e1efe64a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:31.747315 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-58683312-4d74-42e2-a661-dab9e1efe64a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:31.989605 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-f293aa7e-5e93-4b34-8a37-3c5fc066ba71 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:31.992082 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-f293aa7e-5e93-4b34-8a37-3c5fc066ba71 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:31.999046 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f293aa7e-5e93-4b34-8a37-3c5fc066ba71 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:31.999875 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f293aa7e-5e93-4b34-8a37-3c5fc066ba71 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:32.001737 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f293aa7e-5e93-4b34-8a37-3c5fc066ba71 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:32.002648 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f293aa7e-5e93-4b34-8a37-3c5fc066ba71 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:32.057061 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-58683312-4d74-42e2-a661-dab9e1efe64a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:32.066544 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-58683312-4d74-42e2-a661-dab9e1efe64a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:32.068484 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-58683312-4d74-42e2-a661-dab9e1efe64a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:32.069904 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-58683312-4d74-42e2-a661-dab9e1efe64a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1809 microversion: 2.20 time: 0.344582 Oct 28 12:33:32.082372 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 248/481] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:31 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1809 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:32.191831 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f293aa7e-5e93-4b34-8a37-3c5fc066ba71 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:32.204962 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-f293aa7e-5e93-4b34-8a37-3c5fc066ba71 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1508 microversion: 2.1 time: 0.221282 Oct 28 12:33:32.215931 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 234/482] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:31 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1508 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:33.089632 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-78ce5d7e-930c-45ea-bea5-4206976af8c5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:33.090885 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-78ce5d7e-930c-45ea-bea5-4206976af8c5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:33.108638 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-78ce5d7e-930c-45ea-bea5-4206976af8c5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:33.109476 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-78ce5d7e-930c-45ea-bea5-4206976af8c5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:33.110261 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-78ce5d7e-930c-45ea-bea5-4206976af8c5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:33.110682 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-78ce5d7e-930c-45ea-bea5-4206976af8c5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:33.222938 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-7d0f9d37-2bc6-4e5e-9551-7e1e3bab6e68 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:33.223628 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-7d0f9d37-2bc6-4e5e-9551-7e1e3bab6e68 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:33.237587 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7d0f9d37-2bc6-4e5e-9551-7e1e3bab6e68 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:33.238029 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7d0f9d37-2bc6-4e5e-9551-7e1e3bab6e68 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:33.238954 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7d0f9d37-2bc6-4e5e-9551-7e1e3bab6e68 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:33.239370 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7d0f9d37-2bc6-4e5e-9551-7e1e3bab6e68 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:33.283585 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-78ce5d7e-930c-45ea-bea5-4206976af8c5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:33.294783 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-78ce5d7e-930c-45ea-bea5-4206976af8c5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:33.296566 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-78ce5d7e-930c-45ea-bea5-4206976af8c5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:33.298376 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-78ce5d7e-930c-45ea-bea5-4206976af8c5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1809 microversion: 2.20 time: 0.212847 Oct 28 12:33:33.299554 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 249/483] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:33 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1809 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:33.469628 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-7d0f9d37-2bc6-4e5e-9551-7e1e3bab6e68 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:33.478716 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-7d0f9d37-2bc6-4e5e-9551-7e1e3bab6e68 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1508 microversion: 2.1 time: 0.259797 Oct 28 12:33:33.480765 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 235/484] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:33 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1508 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:33:33.865919 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-22baf3f6-ace9-444d-8a4c-73b8b1ada1a7 req-8a22a355-546b-4158-8e1e-ef89627e98ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9a11648-1512-4384-b703-4864b9027474", "name": "network-vif-unplugged", "status": "completed", "tag": "4519c095-ffbc-4831-aac3-a12e3b01647c"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:33:33.868331 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:33:33.868331 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:33:33.878085 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-22baf3f6-ace9-444d-8a4c-73b8b1ada1a7 req-8a22a355-546b-4158-8e1e-ef89627e98ed service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:33.878798 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-22baf3f6-ace9-444d-8a4c-73b8b1ada1a7 req-8a22a355-546b-4158-8e1e-ef89627e98ed service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:33.902132 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-22baf3f6-ace9-444d-8a4c-73b8b1ada1a7 req-8a22a355-546b-4158-8e1e-ef89627e98ed service nova] Creating event network-vif-unplugged:4519c095-ffbc-4831-aac3-a12e3b01647c for instance e9a11648-1512-4384-b703-4864b9027474 on hv-cinder-81514 Oct 28 12:33:33.907526 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-22baf3f6-ace9-444d-8a4c-73b8b1ada1a7 req-8a22a355-546b-4158-8e1e-ef89627e98ed service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045151 Oct 28 12:33:33.908628 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 250/485] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:33:33 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:33:34.319261 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-9b1a3d0d-6fb8-4668-a954-10884ba3f1c0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:34.320688 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-9b1a3d0d-6fb8-4668-a954-10884ba3f1c0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:34.330234 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9b1a3d0d-6fb8-4668-a954-10884ba3f1c0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:34.330888 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9b1a3d0d-6fb8-4668-a954-10884ba3f1c0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:34.331954 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9b1a3d0d-6fb8-4668-a954-10884ba3f1c0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:34.332644 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9b1a3d0d-6fb8-4668-a954-10884ba3f1c0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:34.496560 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-8ed45222-3234-4b50-8334-43a604d9bb83 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:34.498109 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-8ed45222-3234-4b50-8334-43a604d9bb83 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:34.508496 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-9b1a3d0d-6fb8-4668-a954-10884ba3f1c0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:34.511580 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8ed45222-3234-4b50-8334-43a604d9bb83 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:34.512285 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8ed45222-3234-4b50-8334-43a604d9bb83 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:34.513351 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8ed45222-3234-4b50-8334-43a604d9bb83 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:34.515647 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8ed45222-3234-4b50-8334-43a604d9bb83 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:34.519781 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-9b1a3d0d-6fb8-4668-a954-10884ba3f1c0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:34.521637 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-9b1a3d0d-6fb8-4668-a954-10884ba3f1c0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:34.522809 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-9b1a3d0d-6fb8-4668-a954-10884ba3f1c0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1809 microversion: 2.20 time: 0.210121 Oct 28 12:33:34.535517 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 236/486] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:34 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1809 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:34.684406 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-8ed45222-3234-4b50-8334-43a604d9bb83 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:34.692688 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-8ed45222-3234-4b50-8334-43a604d9bb83 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1508 microversion: 2.1 time: 0.200689 Oct 28 12:33:34.693377 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 251/487] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:34 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1508 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:33:35.543654 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-25f9663c-e4ca-4b55-9637-0bade6b65c55 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:35.546247 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-25f9663c-e4ca-4b55-9637-0bade6b65c55 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:35.558559 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-25f9663c-e4ca-4b55-9637-0bade6b65c55 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:35.559372 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-25f9663c-e4ca-4b55-9637-0bade6b65c55 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:35.560410 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-25f9663c-e4ca-4b55-9637-0bade6b65c55 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:35.561046 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-25f9663c-e4ca-4b55-9637-0bade6b65c55 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:35.711829 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-1cc594bb-df02-44ba-ad87-b6bcead1ba20 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:35.712446 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-1cc594bb-df02-44ba-ad87-b6bcead1ba20 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:35.715836 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-25f9663c-e4ca-4b55-9637-0bade6b65c55 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:35.721854 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1cc594bb-df02-44ba-ad87-b6bcead1ba20 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:35.722301 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1cc594bb-df02-44ba-ad87-b6bcead1ba20 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:35.723339 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1cc594bb-df02-44ba-ad87-b6bcead1ba20 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:35.723927 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1cc594bb-df02-44ba-ad87-b6bcead1ba20 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:35.725668 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-25f9663c-e4ca-4b55-9637-0bade6b65c55 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:35.729288 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-25f9663c-e4ca-4b55-9637-0bade6b65c55 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:35.730769 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-25f9663c-e4ca-4b55-9637-0bade6b65c55 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1809 microversion: 2.20 time: 0.191465 Oct 28 12:33:35.732234 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 237/488] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:35 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:35.891980 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-1cc594bb-df02-44ba-ad87-b6bcead1ba20 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:35.900423 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-1cc594bb-df02-44ba-ad87-b6bcead1ba20 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1508 microversion: 2.1 time: 0.192374 Oct 28 12:33:35.910598 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 252/489] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:35 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1508 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:33:36.754063 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-be468d94-f41f-4264-a4db-0df5f329e07a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:36.755488 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-be468d94-f41f-4264-a4db-0df5f329e07a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:36.763485 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-be468d94-f41f-4264-a4db-0df5f329e07a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:36.764298 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-be468d94-f41f-4264-a4db-0df5f329e07a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:36.765157 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-be468d94-f41f-4264-a4db-0df5f329e07a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:36.765795 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-be468d94-f41f-4264-a4db-0df5f329e07a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:36.917861 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-642b2399-c670-4b87-bea5-c491d4823725 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:36.918572 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-642b2399-c670-4b87-bea5-c491d4823725 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:36.930800 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-642b2399-c670-4b87-bea5-c491d4823725 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:36.936590 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-642b2399-c670-4b87-bea5-c491d4823725 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:36.938032 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-642b2399-c670-4b87-bea5-c491d4823725 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:36.945397 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-642b2399-c670-4b87-bea5-c491d4823725 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:37.003737 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-be468d94-f41f-4264-a4db-0df5f329e07a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:37.014963 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-be468d94-f41f-4264-a4db-0df5f329e07a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:37.016542 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-be468d94-f41f-4264-a4db-0df5f329e07a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:37.018121 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-be468d94-f41f-4264-a4db-0df5f329e07a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1809 microversion: 2.20 time: 0.269270 Oct 28 12:33:37.029681 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 238/490] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:36 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1809 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:33:37.212141 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-642b2399-c670-4b87-bea5-c491d4823725 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:37.220112 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-642b2399-c670-4b87-bea5-c491d4823725 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1508 microversion: 2.1 time: 0.306719 Oct 28 12:33:37.220685 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 253/491] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:36 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1508 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:33:38.045500 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-cd63db9d-709f-462d-8488-033f65fe324f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:38.046901 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-cd63db9d-709f-462d-8488-033f65fe324f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:38.076232 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cd63db9d-709f-462d-8488-033f65fe324f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:38.076668 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cd63db9d-709f-462d-8488-033f65fe324f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:38.077885 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cd63db9d-709f-462d-8488-033f65fe324f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:38.078313 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cd63db9d-709f-462d-8488-033f65fe324f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:38.242215 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-cd63db9d-709f-462d-8488-033f65fe324f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:38.243691 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-6f96fc1d-3d96-46be-bf6c-01ed01cad5d3 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:38.244804 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-6f96fc1d-3d96-46be-bf6c-01ed01cad5d3 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:38.253076 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6f96fc1d-3d96-46be-bf6c-01ed01cad5d3 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:38.253622 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6f96fc1d-3d96-46be-bf6c-01ed01cad5d3 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:38.256131 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6f96fc1d-3d96-46be-bf6c-01ed01cad5d3 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:38.256746 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6f96fc1d-3d96-46be-bf6c-01ed01cad5d3 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:38.267612 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-cd63db9d-709f-462d-8488-033f65fe324f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:38.274196 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-cd63db9d-709f-462d-8488-033f65fe324f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:38.275954 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-cd63db9d-709f-462d-8488-033f65fe324f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1809 microversion: 2.20 time: 0.237908 Oct 28 12:33:38.277021 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 239/492] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:38 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1809 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:38.416016 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-6f96fc1d-3d96-46be-bf6c-01ed01cad5d3 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:38.424294 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-6f96fc1d-3d96-46be-bf6c-01ed01cad5d3 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1508 microversion: 2.1 time: 0.184816 Oct 28 12:33:38.436738 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 254/493] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:38 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1508 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:39.295310 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-b5ea27b2-3e12-4df3-b989-774188f7a13f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:39.296799 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-b5ea27b2-3e12-4df3-b989-774188f7a13f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:39.303709 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b5ea27b2-3e12-4df3-b989-774188f7a13f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:39.304440 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b5ea27b2-3e12-4df3-b989-774188f7a13f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:39.305486 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b5ea27b2-3e12-4df3-b989-774188f7a13f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:39.306128 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b5ea27b2-3e12-4df3-b989-774188f7a13f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:39.445912 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-f91a112f-0567-4eee-8afe-c1008fd2a5ac tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:39.446675 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-f91a112f-0567-4eee-8afe-c1008fd2a5ac tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:39.455244 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f91a112f-0567-4eee-8afe-c1008fd2a5ac tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:39.455731 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f91a112f-0567-4eee-8afe-c1008fd2a5ac tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:39.457329 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f91a112f-0567-4eee-8afe-c1008fd2a5ac tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:39.457899 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f91a112f-0567-4eee-8afe-c1008fd2a5ac tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:39.475850 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-b5ea27b2-3e12-4df3-b989-774188f7a13f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:39.485546 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-b5ea27b2-3e12-4df3-b989-774188f7a13f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:39.488877 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-b5ea27b2-3e12-4df3-b989-774188f7a13f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:39.490363 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-b5ea27b2-3e12-4df3-b989-774188f7a13f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1809 microversion: 2.20 time: 0.198977 Oct 28 12:33:39.502140 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 240/494] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:39 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1809 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:39.615207 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-f91a112f-0567-4eee-8afe-c1008fd2a5ac tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:39.624157 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-f91a112f-0567-4eee-8afe-c1008fd2a5ac tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1508 microversion: 2.1 time: 0.183921 Oct 28 12:33:39.634584 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 255/495] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:39 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1508 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:40.509648 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-8699391f-7f59-4a9b-9de2-e6d5b78b6dba tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:40.511225 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-8699391f-7f59-4a9b-9de2-e6d5b78b6dba tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:40.519452 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8699391f-7f59-4a9b-9de2-e6d5b78b6dba tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:40.520346 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8699391f-7f59-4a9b-9de2-e6d5b78b6dba tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:40.521396 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8699391f-7f59-4a9b-9de2-e6d5b78b6dba tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:40.522066 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8699391f-7f59-4a9b-9de2-e6d5b78b6dba tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:40.648443 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-8e3454a8-5400-463e-a0f0-fd0fbaf0521f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:40.649683 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-8e3454a8-5400-463e-a0f0-fd0fbaf0521f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:40.656569 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8e3454a8-5400-463e-a0f0-fd0fbaf0521f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:40.657497 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8e3454a8-5400-463e-a0f0-fd0fbaf0521f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:40.658493 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8e3454a8-5400-463e-a0f0-fd0fbaf0521f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:40.659084 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8e3454a8-5400-463e-a0f0-fd0fbaf0521f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:40.693464 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-8699391f-7f59-4a9b-9de2-e6d5b78b6dba tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:40.703230 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-8699391f-7f59-4a9b-9de2-e6d5b78b6dba tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:40.708054 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-8699391f-7f59-4a9b-9de2-e6d5b78b6dba tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:40.710773 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-8699391f-7f59-4a9b-9de2-e6d5b78b6dba tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1809 microversion: 2.20 time: 0.205091 Oct 28 12:33:40.723513 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 241/496] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:40 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:40.848037 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-8e3454a8-5400-463e-a0f0-fd0fbaf0521f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:40.864027 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-8e3454a8-5400-463e-a0f0-fd0fbaf0521f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1508 microversion: 2.1 time: 0.226325 Oct 28 12:33:40.868089 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 256/497] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:40 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1508 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:41.729870 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-5feedaa1-8001-471d-a413-1bc5c475c365 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:41.730731 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-5feedaa1-8001-471d-a413-1bc5c475c365 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:41.737453 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5feedaa1-8001-471d-a413-1bc5c475c365 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:41.738361 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5feedaa1-8001-471d-a413-1bc5c475c365 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:41.739366 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5feedaa1-8001-471d-a413-1bc5c475c365 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:41.739872 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5feedaa1-8001-471d-a413-1bc5c475c365 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:41.884004 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-6145d772-d99e-44c9-b224-cc8bb9377636 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:41.884797 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-6145d772-d99e-44c9-b224-cc8bb9377636 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:41.892051 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6145d772-d99e-44c9-b224-cc8bb9377636 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:41.892885 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6145d772-d99e-44c9-b224-cc8bb9377636 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:41.893886 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6145d772-d99e-44c9-b224-cc8bb9377636 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:41.894598 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6145d772-d99e-44c9-b224-cc8bb9377636 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:41.952003 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-5feedaa1-8001-471d-a413-1bc5c475c365 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:41.967706 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-5feedaa1-8001-471d-a413-1bc5c475c365 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:41.970373 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-5feedaa1-8001-471d-a413-1bc5c475c365 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:41.971786 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-5feedaa1-8001-471d-a413-1bc5c475c365 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1809 microversion: 2.20 time: 0.245890 Oct 28 12:33:41.976823 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 242/498] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:41 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1809 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:42.126196 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-6145d772-d99e-44c9-b224-cc8bb9377636 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:42.136433 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-6145d772-d99e-44c9-b224-cc8bb9377636 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1508 microversion: 2.1 time: 0.256106 Oct 28 12:33:42.146076 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 257/499] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:41 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1508 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:42.990773 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-694dc37e-dbf1-4edc-bf20-a19e10950278 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:42.991614 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-694dc37e-dbf1-4edc-bf20-a19e10950278 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:43.037652 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-694dc37e-dbf1-4edc-bf20-a19e10950278 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:43.038560 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-694dc37e-dbf1-4edc-bf20-a19e10950278 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:43.050664 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-694dc37e-dbf1-4edc-bf20-a19e10950278 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:43.052163 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-694dc37e-dbf1-4edc-bf20-a19e10950278 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:43.156136 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-76885955-fee0-4828-a443-ea5c1cb48c31 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:43.156943 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-76885955-fee0-4828-a443-ea5c1cb48c31 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:43.183972 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-76885955-fee0-4828-a443-ea5c1cb48c31 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:43.183972 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-76885955-fee0-4828-a443-ea5c1cb48c31 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:43.184699 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-76885955-fee0-4828-a443-ea5c1cb48c31 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:43.200466 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-76885955-fee0-4828-a443-ea5c1cb48c31 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:43.425909 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-76885955-fee0-4828-a443-ea5c1cb48c31 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:43.441907 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-76885955-fee0-4828-a443-ea5c1cb48c31 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1508 microversion: 2.1 time: 0.291566 Oct 28 12:33:43.442540 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 258/500] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:43 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1508 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:33:43.444332 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-694dc37e-dbf1-4edc-bf20-a19e10950278 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:43.462024 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-694dc37e-dbf1-4edc-bf20-a19e10950278 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:43.463407 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-694dc37e-dbf1-4edc-bf20-a19e10950278 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:43.464649 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-694dc37e-dbf1-4edc-bf20-a19e10950278 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1809 microversion: 2.20 time: 0.478117 Oct 28 12:33:43.475985 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 243/501] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:42 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1809 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:44.459582 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-30f9f59d-1495-471b-90c0-75cb61f73316 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:44.460319 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-30f9f59d-1495-471b-90c0-75cb61f73316 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:44.467210 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-30f9f59d-1495-471b-90c0-75cb61f73316 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:44.467651 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-30f9f59d-1495-471b-90c0-75cb61f73316 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:44.468425 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-30f9f59d-1495-471b-90c0-75cb61f73316 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:44.468959 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-30f9f59d-1495-471b-90c0-75cb61f73316 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:44.483760 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-18d953f2-356f-4e90-a857-6629d386e6b2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:44.485195 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-18d953f2-356f-4e90-a857-6629d386e6b2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:44.492062 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-18d953f2-356f-4e90-a857-6629d386e6b2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:44.492862 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-18d953f2-356f-4e90-a857-6629d386e6b2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:44.493881 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-18d953f2-356f-4e90-a857-6629d386e6b2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:44.494517 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-18d953f2-356f-4e90-a857-6629d386e6b2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:44.676605 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-18d953f2-356f-4e90-a857-6629d386e6b2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:44.680062 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-30f9f59d-1495-471b-90c0-75cb61f73316 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:44.690047 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-30f9f59d-1495-471b-90c0-75cb61f73316 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1508 microversion: 2.1 time: 0.234406 Oct 28 12:33:44.690715 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-18d953f2-356f-4e90-a857-6629d386e6b2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:44.692250 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-18d953f2-356f-4e90-a857-6629d386e6b2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:44.693457 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-18d953f2-356f-4e90-a857-6629d386e6b2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1809 microversion: 2.20 time: 0.213614 Oct 28 12:33:44.693999 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 244/502] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:44 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1809 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:44.699484 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 259/503] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:44 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1508 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:45.707729 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-6f48dadd-58ab-45fd-b87f-41ad69bc9b03 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:45.709165 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-6f48dadd-58ab-45fd-b87f-41ad69bc9b03 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:45.714534 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-c66a7476-3a6c-4c55-a84a-bfb11f81fb48 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:45.715299 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-c66a7476-3a6c-4c55-a84a-bfb11f81fb48 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:45.720321 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6f48dadd-58ab-45fd-b87f-41ad69bc9b03 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:45.721374 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6f48dadd-58ab-45fd-b87f-41ad69bc9b03 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:45.722707 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6f48dadd-58ab-45fd-b87f-41ad69bc9b03 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:45.723379 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6f48dadd-58ab-45fd-b87f-41ad69bc9b03 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:45.728459 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c66a7476-3a6c-4c55-a84a-bfb11f81fb48 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:45.729037 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c66a7476-3a6c-4c55-a84a-bfb11f81fb48 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:45.729934 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c66a7476-3a6c-4c55-a84a-bfb11f81fb48 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:45.730459 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c66a7476-3a6c-4c55-a84a-bfb11f81fb48 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:46.045532 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-6f48dadd-58ab-45fd-b87f-41ad69bc9b03 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:46.054592 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-c66a7476-3a6c-4c55-a84a-bfb11f81fb48 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:46.082475 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-c66a7476-3a6c-4c55-a84a-bfb11f81fb48 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:46.083670 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-6f48dadd-58ab-45fd-b87f-41ad69bc9b03 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 200 len: 1508 microversion: 2.1 time: 0.380422 Oct 28 12:33:46.084336 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 245/504] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:45 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 1508 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:46.086491 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-c66a7476-3a6c-4c55-a84a-bfb11f81fb48 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:46.088981 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-c66a7476-3a6c-4c55-a84a-bfb11f81fb48 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1809 microversion: 2.20 time: 0.381392 Oct 28 12:33:46.089938 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 260/505] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:45 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1809 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:33:46.190101 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-8d963a8e-f1ed-4fe2-a3aa-a120b87f68c0 req-2303c43b-ad84-4bbc-a638-70a530694a98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9a11648-1512-4384-b703-4864b9027474", "name": "network-vif-deleted", "tag": "4519c095-ffbc-4831-aac3-a12e3b01647c"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:33:46.192234 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:33:46.192234 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:33:46.201838 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-8d963a8e-f1ed-4fe2-a3aa-a120b87f68c0 req-2303c43b-ad84-4bbc-a638-70a530694a98 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:46.202282 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-8d963a8e-f1ed-4fe2-a3aa-a120b87f68c0 req-2303c43b-ad84-4bbc-a638-70a530694a98 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:46.214472 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-8d963a8e-f1ed-4fe2-a3aa-a120b87f68c0 req-2303c43b-ad84-4bbc-a638-70a530694a98 service nova] Creating event network-vif-deleted:4519c095-ffbc-4831-aac3-a12e3b01647c for instance e9a11648-1512-4384-b703-4864b9027474 on hv-cinder-81514 Oct 28 12:33:46.220499 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-8d963a8e-f1ed-4fe2-a3aa-a120b87f68c0 req-2303c43b-ad84-4bbc-a638-70a530694a98 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034435 Oct 28 12:33:46.221339 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 246/506] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:33:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:33:47.109638 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-4130f020-941f-49b3-9d09-86d647021027 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:47.110274 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-4130f020-941f-49b3-9d09-86d647021027 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:47.115388 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-1e317716-92f8-4507-8124-9e6d4caaeed4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:47.116081 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-1e317716-92f8-4507-8124-9e6d4caaeed4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: e9a11648-1512-4384-b703-4864b9027474] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:47.116703 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4130f020-941f-49b3-9d09-86d647021027 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:47.117138 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4130f020-941f-49b3-9d09-86d647021027 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:47.117875 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4130f020-941f-49b3-9d09-86d647021027 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:47.118309 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4130f020-941f-49b3-9d09-86d647021027 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:47.123021 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1e317716-92f8-4507-8124-9e6d4caaeed4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:47.123458 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1e317716-92f8-4507-8124-9e6d4caaeed4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:47.124239 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1e317716-92f8-4507-8124-9e6d4caaeed4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:47.124662 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1e317716-92f8-4507-8124-9e6d4caaeed4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:47.138395 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.wsgi [None req-1e317716-92f8-4507-8124-9e6d4caaeed4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] HTTP exception thrown: Instance e9a11648-1512-4384-b703-4864b9027474 could not be found. Oct 28 12:33:47.138965 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-1e317716-92f8-4507-8124-9e6d4caaeed4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Returning 404 to user: Instance e9a11648-1512-4384-b703-4864b9027474 could not be found. {{(pid=115876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:33:47.139941 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-1e317716-92f8-4507-8124-9e6d4caaeed4 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474" status: 404 len: 111 microversion: 2.1 time: 0.033229 Oct 28 12:33:47.140747 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 247/507] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:47 2021] GET /compute/v2.1/servers/e9a11648-1512-4384-b703-4864b9027474 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:33:47.151348 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-cf5feb77-0ff9-49fc-a826-9983dfe77b5d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:47.151818 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-cf5feb77-0ff9-49fc-a826-9983dfe77b5d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:47.158182 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cf5feb77-0ff9-49fc-a826-9983dfe77b5d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:47.158641 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cf5feb77-0ff9-49fc-a826-9983dfe77b5d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:47.160517 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cf5feb77-0ff9-49fc-a826-9983dfe77b5d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:47.160994 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cf5feb77-0ff9-49fc-a826-9983dfe77b5d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:47.195732 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-cf5feb77-0ff9-49fc-a826-9983dfe77b5d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Going to try to terminate instance {{(pid=115876) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:33:47.274359 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-4130f020-941f-49b3-9d09-86d647021027 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:47.284038 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-cf5feb77-0ff9-49fc-a826-9983dfe77b5d tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "DELETE /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 204 len: 0 microversion: 2.1 time: 0.136032 Oct 28 12:33:47.285490 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-4130f020-941f-49b3-9d09-86d647021027 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:47.288829 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 248/508] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Oct 28 12:33:47 2021] DELETE /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:33:47.291513 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-4130f020-941f-49b3-9d09-86d647021027 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:47.293300 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-4130f020-941f-49b3-9d09-86d647021027 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1809 microversion: 2.20 time: 0.187629 Oct 28 12:33:47.304795 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-16cde8fe-b9ce-4060-99b8-8c2290caa4e7 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:47.304795 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-16cde8fe-b9ce-4060-99b8-8c2290caa4e7 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:47.304795 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-16cde8fe-b9ce-4060-99b8-8c2290caa4e7 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:47.304795 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-16cde8fe-b9ce-4060-99b8-8c2290caa4e7 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:47.305351 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-16cde8fe-b9ce-4060-99b8-8c2290caa4e7 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:47.305351 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-16cde8fe-b9ce-4060-99b8-8c2290caa4e7 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:47.307902 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 261/509] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:47 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1809 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:47.375070 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-75ef1dcd-3cfc-4377-86fd-73cf8d87a36b tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:47.375546 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-75ef1dcd-3cfc-4377-86fd-73cf8d87a36b tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: e9dc74b0-0412-4f1d-ba9f-18c7b792df75] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:47.382027 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-75ef1dcd-3cfc-4377-86fd-73cf8d87a36b tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:47.382709 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-75ef1dcd-3cfc-4377-86fd-73cf8d87a36b tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:47.383766 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-75ef1dcd-3cfc-4377-86fd-73cf8d87a36b tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:47.384191 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-75ef1dcd-3cfc-4377-86fd-73cf8d87a36b tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:47.416454 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-75ef1dcd-3cfc-4377-86fd-73cf8d87a36b tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: e9dc74b0-0412-4f1d-ba9f-18c7b792df75] Going to try to terminate instance {{(pid=115877) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:33:47.474615 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-16cde8fe-b9ce-4060-99b8-8c2290caa4e7 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:47.483236 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-16cde8fe-b9ce-4060-99b8-8c2290caa4e7 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1520 microversion: 2.1 time: 0.192878 Oct 28 12:33:47.484176 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 249/510] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:47 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:47.517124 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-75ef1dcd-3cfc-4377-86fd-73cf8d87a36b tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75" status: 204 len: 0 microversion: 2.1 time: 0.145465 Oct 28 12:33:47.517923 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 262/511] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Oct 28 12:33:47 2021] DELETE /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 12:33:47.526768 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-b5de5c21-48f7-48c7-95fa-fa4a7d167138 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:47.528142 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-b5de5c21-48f7-48c7-95fa-fa4a7d167138 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: e9dc74b0-0412-4f1d-ba9f-18c7b792df75] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:47.535166 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b5de5c21-48f7-48c7-95fa-fa4a7d167138 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:47.535603 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b5de5c21-48f7-48c7-95fa-fa4a7d167138 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:47.536418 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b5de5c21-48f7-48c7-95fa-fa4a7d167138 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:47.536879 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b5de5c21-48f7-48c7-95fa-fa4a7d167138 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:47.675484 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-b5de5c21-48f7-48c7-95fa-fa4a7d167138 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a27389ddb44f893f2975cab49ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94643fb6f71b47f79d194ad0849be625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:47.685714 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-b5de5c21-48f7-48c7-95fa-fa4a7d167138 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "GET /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75" status: 200 len: 1514 microversion: 2.1 time: 0.162532 Oct 28 12:33:47.686293 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 250/512] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:47 2021] GET /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:48.316937 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-cbba7738-40e5-49b1-99b0-3f9df618aab0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:48.317888 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-cbba7738-40e5-49b1-99b0-3f9df618aab0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:48.325111 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-cbba7738-40e5-49b1-99b0-3f9df618aab0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:48.325461 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-cbba7738-40e5-49b1-99b0-3f9df618aab0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:48.326242 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-cbba7738-40e5-49b1-99b0-3f9df618aab0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:48.326662 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-cbba7738-40e5-49b1-99b0-3f9df618aab0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:48.464468 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-cbba7738-40e5-49b1-99b0-3f9df618aab0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:48.474066 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-cbba7738-40e5-49b1-99b0-3f9df618aab0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:48.475598 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-cbba7738-40e5-49b1-99b0-3f9df618aab0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:48.476867 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-cbba7738-40e5-49b1-99b0-3f9df618aab0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1809 microversion: 2.20 time: 0.164510 Oct 28 12:33:48.477415 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 263/513] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:48 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:48.502453 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-b76992e6-ee64-4cf6-b4aa-cb75b03862b5 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:48.503033 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-b76992e6-ee64-4cf6-b4aa-cb75b03862b5 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:48.510418 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b76992e6-ee64-4cf6-b4aa-cb75b03862b5 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:48.510853 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b76992e6-ee64-4cf6-b4aa-cb75b03862b5 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:48.511636 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b76992e6-ee64-4cf6-b4aa-cb75b03862b5 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:48.512059 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b76992e6-ee64-4cf6-b4aa-cb75b03862b5 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:48.652951 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-b76992e6-ee64-4cf6-b4aa-cb75b03862b5 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:48.662286 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-b76992e6-ee64-4cf6-b4aa-cb75b03862b5 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1520 microversion: 2.1 time: 0.163791 Oct 28 12:33:48.662854 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 251/514] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:48 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:48.703244 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-8b8e269f-f26f-4bd7-945c-746f9c630c8f tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:48.703821 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-8b8e269f-f26f-4bd7-945c-746f9c630c8f tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: e9dc74b0-0412-4f1d-ba9f-18c7b792df75] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:48.710323 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8b8e269f-f26f-4bd7-945c-746f9c630c8f tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:48.710775 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8b8e269f-f26f-4bd7-945c-746f9c630c8f tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:48.711545 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8b8e269f-f26f-4bd7-945c-746f9c630c8f tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:48.711970 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8b8e269f-f26f-4bd7-945c-746f9c630c8f tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:48.839259 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-8b8e269f-f26f-4bd7-945c-746f9c630c8f tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a27389ddb44f893f2975cab49ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94643fb6f71b47f79d194ad0849be625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:48.846945 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-8b8e269f-f26f-4bd7-945c-746f9c630c8f tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "GET /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75" status: 200 len: 1514 microversion: 2.1 time: 0.147450 Oct 28 12:33:48.847509 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 264/515] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:48 2021] GET /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:49.495909 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-ed19a30a-4f87-45a9-9a8c-bd6ae62e4ae7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:49.496635 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-ed19a30a-4f87-45a9-9a8c-bd6ae62e4ae7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:49.503136 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ed19a30a-4f87-45a9-9a8c-bd6ae62e4ae7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:49.503737 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ed19a30a-4f87-45a9-9a8c-bd6ae62e4ae7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:49.504317 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ed19a30a-4f87-45a9-9a8c-bd6ae62e4ae7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:49.504744 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ed19a30a-4f87-45a9-9a8c-bd6ae62e4ae7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:49.679510 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-3783e31f-bc95-47e1-a655-a14784e05dea tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:49.680379 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-3783e31f-bc95-47e1-a655-a14784e05dea tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:49.687423 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3783e31f-bc95-47e1-a655-a14784e05dea tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:49.687864 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3783e31f-bc95-47e1-a655-a14784e05dea tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:49.688653 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3783e31f-bc95-47e1-a655-a14784e05dea tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:49.689106 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3783e31f-bc95-47e1-a655-a14784e05dea tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:49.712980 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-ed19a30a-4f87-45a9-9a8c-bd6ae62e4ae7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:49.723466 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-ed19a30a-4f87-45a9-9a8c-bd6ae62e4ae7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:49.725807 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-ed19a30a-4f87-45a9-9a8c-bd6ae62e4ae7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:49.727472 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-ed19a30a-4f87-45a9-9a8c-bd6ae62e4ae7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1809 microversion: 2.20 time: 0.235275 Oct 28 12:33:49.728322 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 252/516] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:49 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1809 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:49.863520 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-ce57ea1e-1e26-4972-bcfb-22ed87be30cb tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:49.864170 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-ce57ea1e-1e26-4972-bcfb-22ed87be30cb tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: e9dc74b0-0412-4f1d-ba9f-18c7b792df75] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:49.870633 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ce57ea1e-1e26-4972-bcfb-22ed87be30cb tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:49.871107 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ce57ea1e-1e26-4972-bcfb-22ed87be30cb tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:49.871873 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ce57ea1e-1e26-4972-bcfb-22ed87be30cb tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:49.872273 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ce57ea1e-1e26-4972-bcfb-22ed87be30cb tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:49.905236 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-3783e31f-bc95-47e1-a655-a14784e05dea tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:49.913019 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-3783e31f-bc95-47e1-a655-a14784e05dea tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1520 microversion: 2.1 time: 0.237253 Oct 28 12:33:49.913598 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 265/517] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:49 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:50.085065 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-ce57ea1e-1e26-4972-bcfb-22ed87be30cb tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a27389ddb44f893f2975cab49ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94643fb6f71b47f79d194ad0849be625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:50.093022 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-ce57ea1e-1e26-4972-bcfb-22ed87be30cb tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "GET /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75" status: 200 len: 1514 microversion: 2.1 time: 0.232967 Oct 28 12:33:50.093605 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 253/518] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:49 2021] GET /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75 => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:50.182761 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-dcc4ed39-2c53-4cec-a050-bb61ce09595c req-3bc468ae-442c-4288-ad24-43304b3d2b24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9dc74b0-0412-4f1d-ba9f-18c7b792df75", "name": "network-vif-deleted", "tag": "b39e2281-2702-459d-917b-89f8a06e12f4"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:33:50.184963 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:33:50.184963 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:33:50.193149 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-dcc4ed39-2c53-4cec-a050-bb61ce09595c req-3bc468ae-442c-4288-ad24-43304b3d2b24 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:50.193606 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-dcc4ed39-2c53-4cec-a050-bb61ce09595c req-3bc468ae-442c-4288-ad24-43304b3d2b24 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:50.205118 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-dcc4ed39-2c53-4cec-a050-bb61ce09595c req-3bc468ae-442c-4288-ad24-43304b3d2b24 service nova] Creating event network-vif-deleted:b39e2281-2702-459d-917b-89f8a06e12f4 for instance e9dc74b0-0412-4f1d-ba9f-18c7b792df75 on hv-cinder-81514 Oct 28 12:33:50.210366 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-dcc4ed39-2c53-4cec-a050-bb61ce09595c req-3bc468ae-442c-4288-ad24-43304b3d2b24 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031700 Oct 28 12:33:50.210989 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 266/519] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:33:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:33:50.747469 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-d9ccf0d8-a767-4b04-a160-da72cc86561e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:50.748093 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-d9ccf0d8-a767-4b04-a160-da72cc86561e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:50.755494 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d9ccf0d8-a767-4b04-a160-da72cc86561e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:50.755925 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d9ccf0d8-a767-4b04-a160-da72cc86561e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:50.756675 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d9ccf0d8-a767-4b04-a160-da72cc86561e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:50.757171 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d9ccf0d8-a767-4b04-a160-da72cc86561e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:50.887946 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-d9ccf0d8-a767-4b04-a160-da72cc86561e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:50.896876 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-d9ccf0d8-a767-4b04-a160-da72cc86561e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:50.898344 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-d9ccf0d8-a767-4b04-a160-da72cc86561e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:50.899496 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-d9ccf0d8-a767-4b04-a160-da72cc86561e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1809 microversion: 2.20 time: 0.155875 Oct 28 12:33:50.900054 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 254/520] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:50 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:50.935291 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-828d75e6-7674-4cbc-9802-73251a355ea2 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:50.936321 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-828d75e6-7674-4cbc-9802-73251a355ea2 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:50.945307 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-828d75e6-7674-4cbc-9802-73251a355ea2 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:50.945757 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-828d75e6-7674-4cbc-9802-73251a355ea2 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:50.946545 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-828d75e6-7674-4cbc-9802-73251a355ea2 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:50.946980 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-828d75e6-7674-4cbc-9802-73251a355ea2 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:51.079437 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-828d75e6-7674-4cbc-9802-73251a355ea2 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:51.087156 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-828d75e6-7674-4cbc-9802-73251a355ea2 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1520 microversion: 2.1 time: 0.159744 Oct 28 12:33:51.087730 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 267/521] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:50 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:51.111632 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-5b6dd525-dba6-45ce-a7ec-02366b815f86 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:51.112227 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-5b6dd525-dba6-45ce-a7ec-02366b815f86 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: e9dc74b0-0412-4f1d-ba9f-18c7b792df75] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:51.118799 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5b6dd525-dba6-45ce-a7ec-02366b815f86 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:51.119311 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5b6dd525-dba6-45ce-a7ec-02366b815f86 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:51.120069 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5b6dd525-dba6-45ce-a7ec-02366b815f86 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:51.120488 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5b6dd525-dba6-45ce-a7ec-02366b815f86 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:51.133964 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.wsgi [None req-5b6dd525-dba6-45ce-a7ec-02366b815f86 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] HTTP exception thrown: Instance e9dc74b0-0412-4f1d-ba9f-18c7b792df75 could not be found. Oct 28 12:33:51.134543 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-5b6dd525-dba6-45ce-a7ec-02366b815f86 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Returning 404 to user: Instance e9dc74b0-0412-4f1d-ba9f-18c7b792df75 could not be found. {{(pid=115876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:33:51.135417 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-5b6dd525-dba6-45ce-a7ec-02366b815f86 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "GET /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75" status: 404 len: 111 microversion: 2.1 time: 0.027506 Oct 28 12:33:51.135892 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 255/522] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:51 2021] GET /compute/v2.1/servers/e9dc74b0-0412-4f1d-ba9f-18c7b792df75 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:33:51.957390 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-01084310-1303-4a51-8f15-1cec1e08ffa5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:51.957959 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-01084310-1303-4a51-8f15-1cec1e08ffa5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:51.964992 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-01084310-1303-4a51-8f15-1cec1e08ffa5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:51.965438 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-01084310-1303-4a51-8f15-1cec1e08ffa5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:51.966205 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-01084310-1303-4a51-8f15-1cec1e08ffa5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:51.966611 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-01084310-1303-4a51-8f15-1cec1e08ffa5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:52.096555 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-01084310-1303-4a51-8f15-1cec1e08ffa5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:52.103838 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-2ac19620-f889-4255-b6f6-e8c8d9bcbf73 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:52.104470 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-2ac19620-f889-4255-b6f6-e8c8d9bcbf73 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:52.105234 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-01084310-1303-4a51-8f15-1cec1e08ffa5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:52.106865 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-01084310-1303-4a51-8f15-1cec1e08ffa5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:52.108195 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-01084310-1303-4a51-8f15-1cec1e08ffa5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1809 microversion: 2.20 time: 0.154733 Oct 28 12:33:52.108788 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 268/523] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:51 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:52.111072 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2ac19620-f889-4255-b6f6-e8c8d9bcbf73 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:52.111508 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2ac19620-f889-4255-b6f6-e8c8d9bcbf73 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:52.112276 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2ac19620-f889-4255-b6f6-e8c8d9bcbf73 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:52.112703 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2ac19620-f889-4255-b6f6-e8c8d9bcbf73 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:52.250276 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-2ac19620-f889-4255-b6f6-e8c8d9bcbf73 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:52.257959 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-2ac19620-f889-4255-b6f6-e8c8d9bcbf73 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1520 microversion: 2.1 time: 0.157877 Oct 28 12:33:52.258517 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 256/524] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:52 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:53.130216 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-d5077c77-80f4-4c6e-a1b6-76f991b1514b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:53.131052 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-d5077c77-80f4-4c6e-a1b6-76f991b1514b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:53.137656 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d5077c77-80f4-4c6e-a1b6-76f991b1514b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:53.138109 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d5077c77-80f4-4c6e-a1b6-76f991b1514b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:53.138878 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d5077c77-80f4-4c6e-a1b6-76f991b1514b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:53.139302 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d5077c77-80f4-4c6e-a1b6-76f991b1514b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:53.276649 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-1600c3ef-d39a-45e5-a063-983b3e0a1eec tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:53.277252 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-1600c3ef-d39a-45e5-a063-983b3e0a1eec tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:53.281668 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-d5077c77-80f4-4c6e-a1b6-76f991b1514b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:53.283768 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1600c3ef-d39a-45e5-a063-983b3e0a1eec tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:53.284209 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1600c3ef-d39a-45e5-a063-983b3e0a1eec tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:53.284992 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1600c3ef-d39a-45e5-a063-983b3e0a1eec tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:53.285422 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1600c3ef-d39a-45e5-a063-983b3e0a1eec tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:53.290763 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-d5077c77-80f4-4c6e-a1b6-76f991b1514b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:53.292338 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-d5077c77-80f4-4c6e-a1b6-76f991b1514b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:53.293660 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-d5077c77-80f4-4c6e-a1b6-76f991b1514b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1809 microversion: 2.20 time: 0.170128 Oct 28 12:33:53.294195 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 269/525] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:53 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:53.418738 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-1600c3ef-d39a-45e5-a063-983b3e0a1eec tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:53.428831 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-1600c3ef-d39a-45e5-a063-983b3e0a1eec tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1520 microversion: 2.1 time: 0.155772 Oct 28 12:33:53.429467 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 257/526] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:53 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:54.311892 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-694d0b8c-577d-4ff1-b557-e880f2809694 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:54.312584 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-694d0b8c-577d-4ff1-b557-e880f2809694 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:54.319486 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-694d0b8c-577d-4ff1-b557-e880f2809694 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:54.320027 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-694d0b8c-577d-4ff1-b557-e880f2809694 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:54.321150 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-694d0b8c-577d-4ff1-b557-e880f2809694 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:54.321773 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-694d0b8c-577d-4ff1-b557-e880f2809694 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:54.450885 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-b36148c7-8761-4f42-a202-b771b46ff987 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:54.451583 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-b36148c7-8761-4f42-a202-b771b46ff987 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:54.456843 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-694d0b8c-577d-4ff1-b557-e880f2809694 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:54.458418 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b36148c7-8761-4f42-a202-b771b46ff987 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:54.458896 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b36148c7-8761-4f42-a202-b771b46ff987 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:54.459686 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b36148c7-8761-4f42-a202-b771b46ff987 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:54.460095 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b36148c7-8761-4f42-a202-b771b46ff987 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:54.465910 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-694d0b8c-577d-4ff1-b557-e880f2809694 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:54.467379 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-694d0b8c-577d-4ff1-b557-e880f2809694 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:54.468533 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-694d0b8c-577d-4ff1-b557-e880f2809694 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1809 microversion: 2.20 time: 0.160477 Oct 28 12:33:54.469183 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 270/527] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:54 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:54.601618 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-b36148c7-8761-4f42-a202-b771b46ff987 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:54.610049 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-b36148c7-8761-4f42-a202-b771b46ff987 tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1520 microversion: 2.1 time: 0.162818 Oct 28 12:33:54.610605 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 258/528] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:54 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:55.488778 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-3f7e8ea4-cc9d-4e29-93b4-9292b6b1c10a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:55.489686 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-3f7e8ea4-cc9d-4e29-93b4-9292b6b1c10a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:55.496527 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3f7e8ea4-cc9d-4e29-93b4-9292b6b1c10a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:55.497152 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3f7e8ea4-cc9d-4e29-93b4-9292b6b1c10a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:55.497938 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3f7e8ea4-cc9d-4e29-93b4-9292b6b1c10a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:55.498370 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3f7e8ea4-cc9d-4e29-93b4-9292b6b1c10a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:55.628146 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-25a6a4ce-7f07-4fbb-b0bb-ed07bafb7ffb tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:55.628742 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-25a6a4ce-7f07-4fbb-b0bb-ed07bafb7ffb tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:55.637777 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-25a6a4ce-7f07-4fbb-b0bb-ed07bafb7ffb tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:55.638218 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-25a6a4ce-7f07-4fbb-b0bb-ed07bafb7ffb tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:55.639005 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-25a6a4ce-7f07-4fbb-b0bb-ed07bafb7ffb tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:55.639422 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-25a6a4ce-7f07-4fbb-b0bb-ed07bafb7ffb tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:55.721173 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-25a6a4ce-7f07-4fbb-b0bb-ed07bafb7ffb tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed2a525287d4d5cbde5977afba29c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89341f96003c41e9be94073b0ef97275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:55.733244 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-25a6a4ce-7f07-4fbb-b0bb-ed07bafb7ffb tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 200 len: 1478 microversion: 2.1 time: 0.109072 Oct 28 12:33:55.743640 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 259/529] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:55 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 1478 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:33:55.745198 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-3f7e8ea4-cc9d-4e29-93b4-9292b6b1c10a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:55.748982 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-fcf9d2fc-e1c6-48f4-8b48-de38658632ea req-08e60a48-1fb7-46da-9cab-0d97aff0c76b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "358e5707-b5af-4ff5-9308-489054458c20", "name": "network-vif-deleted", "tag": "c200af92-6387-4188-81f1-0baf6b616b1f"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:33:55.750783 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:33:55.750783 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:33:55.758130 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-fcf9d2fc-e1c6-48f4-8b48-de38658632ea req-08e60a48-1fb7-46da-9cab-0d97aff0c76b service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:55.758464 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-3f7e8ea4-cc9d-4e29-93b4-9292b6b1c10a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:55.758629 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-fcf9d2fc-e1c6-48f4-8b48-de38658632ea req-08e60a48-1fb7-46da-9cab-0d97aff0c76b service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:55.760972 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-3f7e8ea4-cc9d-4e29-93b4-9292b6b1c10a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:55.762225 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-3f7e8ea4-cc9d-4e29-93b4-9292b6b1c10a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1809 microversion: 2.20 time: 0.278725 Oct 28 12:33:55.763633 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 271/530] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:55 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1809 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:55.772063 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-fcf9d2fc-e1c6-48f4-8b48-de38658632ea req-08e60a48-1fb7-46da-9cab-0d97aff0c76b service nova] Creating event network-vif-deleted:c200af92-6387-4188-81f1-0baf6b616b1f for instance 358e5707-b5af-4ff5-9308-489054458c20 on hv-cinder-81514 Oct 28 12:33:55.778894 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-fcf9d2fc-e1c6-48f4-8b48-de38658632ea req-08e60a48-1fb7-46da-9cab-0d97aff0c76b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033337 Oct 28 12:33:55.779692 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 260/531] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:33:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:33:56.750900 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-90f577ee-f9b2-4a63-ae62-60c4ad52840f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:56.751566 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-90f577ee-f9b2-4a63-ae62-60c4ad52840f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] [instance: 358e5707-b5af-4ff5-9308-489054458c20] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:56.759106 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-90f577ee-f9b2-4a63-ae62-60c4ad52840f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:56.759798 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-90f577ee-f9b2-4a63-ae62-60c4ad52840f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:56.760845 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-90f577ee-f9b2-4a63-ae62-60c4ad52840f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:56.760845 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-90f577ee-f9b2-4a63-ae62-60c4ad52840f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:56.775954 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.wsgi [None req-90f577ee-f9b2-4a63-ae62-60c4ad52840f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] HTTP exception thrown: Instance 358e5707-b5af-4ff5-9308-489054458c20 could not be found. Oct 28 12:33:56.776731 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-90f577ee-f9b2-4a63-ae62-60c4ad52840f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] Returning 404 to user: Instance 358e5707-b5af-4ff5-9308-489054458c20 could not be found. {{(pid=115877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:33:56.777920 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-90f577ee-f9b2-4a63-ae62-60c4ad52840f tempest-ServerRescueNegativeTestJSON-1167639661 tempest-ServerRescueNegativeTestJSON-1167639661-project] 10.222.0.62 "GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20" status: 404 len: 111 microversion: 2.1 time: 0.030971 Oct 28 12:33:56.778749 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 272/532] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:33:56 2021] GET /compute/v2.1/servers/358e5707-b5af-4ff5-9308-489054458c20 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:33:56.784546 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-5c602840-37fc-4c98-920d-3d3d61b96a08 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:56.785261 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-5c602840-37fc-4c98-920d-3d3d61b96a08 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:56.791990 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5c602840-37fc-4c98-920d-3d3d61b96a08 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:56.792476 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5c602840-37fc-4c98-920d-3d3d61b96a08 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:56.793284 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5c602840-37fc-4c98-920d-3d3d61b96a08 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:56.793707 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5c602840-37fc-4c98-920d-3d3d61b96a08 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:57.046271 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-5c602840-37fc-4c98-920d-3d3d61b96a08 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:57.055513 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-5c602840-37fc-4c98-920d-3d3d61b96a08 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:57.057610 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-5c602840-37fc-4c98-920d-3d3d61b96a08 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:57.058850 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-5c602840-37fc-4c98-920d-3d3d61b96a08 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1809 microversion: 2.20 time: 0.280230 Oct 28 12:33:57.059398 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 261/533] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:56 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1809 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:33:58.076894 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-d686e5d3-47b1-460b-842a-bf14ad9469eb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:58.077462 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-d686e5d3-47b1-460b-842a-bf14ad9469eb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:58.084423 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d686e5d3-47b1-460b-842a-bf14ad9469eb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:58.084935 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d686e5d3-47b1-460b-842a-bf14ad9469eb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:58.085818 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d686e5d3-47b1-460b-842a-bf14ad9469eb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:58.086299 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d686e5d3-47b1-460b-842a-bf14ad9469eb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:58.327355 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-d686e5d3-47b1-460b-842a-bf14ad9469eb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:58.336680 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-d686e5d3-47b1-460b-842a-bf14ad9469eb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:58.338202 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-d686e5d3-47b1-460b-842a-bf14ad9469eb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:58.339372 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-d686e5d3-47b1-460b-842a-bf14ad9469eb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1809 microversion: 2.20 time: 0.266281 Oct 28 12:33:58.339927 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 273/534] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:58 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1809 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:33:59.360392 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-8b54dcf1-1839-4b25-84d5-fce6805184f8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:33:59.361027 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-8b54dcf1-1839-4b25-84d5-fce6805184f8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:33:59.368380 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8b54dcf1-1839-4b25-84d5-fce6805184f8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:59.368759 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8b54dcf1-1839-4b25-84d5-fce6805184f8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:59.369555 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8b54dcf1-1839-4b25-84d5-fce6805184f8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:33:59.369992 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8b54dcf1-1839-4b25-84d5-fce6805184f8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:33:59.706600 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-8b54dcf1-1839-4b25-84d5-fce6805184f8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:59.723385 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-8b54dcf1-1839-4b25-84d5-fce6805184f8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:59.729698 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-8b54dcf1-1839-4b25-84d5-fce6805184f8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:33:59.732411 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-8b54dcf1-1839-4b25-84d5-fce6805184f8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1809 microversion: 2.20 time: 0.376062 Oct 28 12:33:59.734017 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 262/535] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:33:59 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1809 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:34:00.753763 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-526d0f92-f9fd-42de-bb40-f414036f2480 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:00.754531 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-526d0f92-f9fd-42de-bb40-f414036f2480 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:00.762789 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-526d0f92-f9fd-42de-bb40-f414036f2480 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:00.763628 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-526d0f92-f9fd-42de-bb40-f414036f2480 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:00.764943 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-526d0f92-f9fd-42de-bb40-f414036f2480 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:00.765457 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-526d0f92-f9fd-42de-bb40-f414036f2480 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:00.908864 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-526d0f92-f9fd-42de-bb40-f414036f2480 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:00.919079 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-526d0f92-f9fd-42de-bb40-f414036f2480 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:00.920551 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-526d0f92-f9fd-42de-bb40-f414036f2480 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:00.922363 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-526d0f92-f9fd-42de-bb40-f414036f2480 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1809 microversion: 2.20 time: 0.174205 Oct 28 12:34:00.922525 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 274/536] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:34:00 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:34:01.088634 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-0cfd7cf5-aded-4b72-bb90-57f3071c9730 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1033491769", "imageRef": "575f28c8-0af2-4973-b3d9-a249e2400c6e", "flavorRef": "452", "networks": [{"uuid": "5d883604-b2a9-4d93-a8bf-ec87e84b1b2c"}]}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:34:01.145608 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.network.neutron [None req-0cfd7cf5-aded-4b72-bb90-57f3071c9730 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] validate_networks() for [('5d883604-b2a9-4d93-a8bf-ec87e84b1b2c', None, None, None, None, None)] {{(pid=115876) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:34:01.515008 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-0cfd7cf5-aded-4b72-bb90-57f3071c9730 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Flavor limits 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:34:01.515446 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-0cfd7cf5-aded-4b72-bb90-57f3071c9730 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Image limits 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:34:01.515906 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-0cfd7cf5-aded-4b72-bb90-57f3071c9730 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Flavor pref 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:34:01.516304 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-0cfd7cf5-aded-4b72-bb90-57f3071c9730 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Image pref 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:34:01.516700 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-0cfd7cf5-aded-4b72-bb90-57f3071c9730 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:34:01.525693 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-0cfd7cf5-aded-4b72-bb90-57f3071c9730 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:01.526134 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-0cfd7cf5-aded-4b72-bb90-57f3071c9730 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:01.526917 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-0cfd7cf5-aded-4b72-bb90-57f3071c9730 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:01.527401 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-0cfd7cf5-aded-4b72-bb90-57f3071c9730 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:01.545164 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-0cfd7cf5-aded-4b72-bb90-57f3071c9730 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Getting quotas for project 94643fb6f71b47f79d194ad0849be625. Resources: {'cores', 'instances', 'ram'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:34:01.550611 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-0cfd7cf5-aded-4b72-bb90-57f3071c9730 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Getting quotas for user ba3a27389ddb44f893f2975cab49ef7a and project 94643fb6f71b47f79d194ad0849be625. Resources: {'cores', 'instances', 'ram'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:34:01.568681 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-0cfd7cf5-aded-4b72-bb90-57f3071c9730 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Going to run 1 instances... {{(pid=115876) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:34:01.571294 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-0cfd7cf5-aded-4b72-bb90-57f3071c9730 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: b5fbde14-9db9-42a1-ad66-7a9510756fa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='575f28c8-0af2-4973-b3d9-a249e2400c6e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:34:01.617598 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-0cfd7cf5-aded-4b72-bb90-57f3071c9730 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543641 Oct 28 12:34:01.618257 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 263/537] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Oct 28 12:34:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 12:34:01.627951 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-1ed6492f-99cc-4630-8dc1-d31422bc2678 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:01.628569 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-1ed6492f-99cc-4630-8dc1-d31422bc2678 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: b5fbde14-9db9-42a1-ad66-7a9510756fa9] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:01.693148 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-1ed6492f-99cc-4630-8dc1-d31422bc2678 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a27389ddb44f893f2975cab49ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94643fb6f71b47f79d194ad0849be625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:01.707227 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-1ed6492f-99cc-4630-8dc1-d31422bc2678 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "GET /compute/v2.1/servers/b5fbde14-9db9-42a1-ad66-7a9510756fa9" status: 200 len: 1219 microversion: 2.1 time: 0.082536 Oct 28 12:34:01.708633 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 275/538] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:01 2021] GET /compute/v2.1/servers/b5fbde14-9db9-42a1-ad66-7a9510756fa9 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:01.942699 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-af2330aa-bdc2-443c-8f63-6e84bb9bdf4c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:01.945096 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-af2330aa-bdc2-443c-8f63-6e84bb9bdf4c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:01.961588 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-af2330aa-bdc2-443c-8f63-6e84bb9bdf4c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:01.962664 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-af2330aa-bdc2-443c-8f63-6e84bb9bdf4c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:01.963932 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-af2330aa-bdc2-443c-8f63-6e84bb9bdf4c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:01.964528 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-af2330aa-bdc2-443c-8f63-6e84bb9bdf4c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:02.156495 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-af2330aa-bdc2-443c-8f63-6e84bb9bdf4c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:02.170145 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-af2330aa-bdc2-443c-8f63-6e84bb9bdf4c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:02.171669 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-af2330aa-bdc2-443c-8f63-6e84bb9bdf4c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:02.179436 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-af2330aa-bdc2-443c-8f63-6e84bb9bdf4c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1809 microversion: 2.20 time: 0.241958 Oct 28 12:34:02.180538 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 264/539] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:34:01 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1809 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:34:02.726713 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-bd9c249c-66bb-4632-a56d-68af2e162298 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:02.727303 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-bd9c249c-66bb-4632-a56d-68af2e162298 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: b5fbde14-9db9-42a1-ad66-7a9510756fa9] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:02.733974 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-bd9c249c-66bb-4632-a56d-68af2e162298 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:02.734585 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-bd9c249c-66bb-4632-a56d-68af2e162298 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:02.738153 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-bd9c249c-66bb-4632-a56d-68af2e162298 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:02.738853 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-bd9c249c-66bb-4632-a56d-68af2e162298 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:02.756126 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-554cad96-983b-4d9d-86ee-97dce2d6b3ce tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-482985193", "imageRef": "575f28c8-0af2-4973-b3d9-a249e2400c6e", "flavorRef": "452", "networks": [{"uuid": "e80a2853-2c5f-4e30-b57e-4bb32d36cb7b"}]}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:34:02.828123 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-bd9c249c-66bb-4632-a56d-68af2e162298 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a27389ddb44f893f2975cab49ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94643fb6f71b47f79d194ad0849be625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:02.840380 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-bd9c249c-66bb-4632-a56d-68af2e162298 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "GET /compute/v2.1/servers/b5fbde14-9db9-42a1-ad66-7a9510756fa9" status: 200 len: 1279 microversion: 2.1 time: 0.118258 Oct 28 12:34:02.847525 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.network.neutron [None req-554cad96-983b-4d9d-86ee-97dce2d6b3ce tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] validate_networks() for [('e80a2853-2c5f-4e30-b57e-4bb32d36cb7b', None, None, None, None, None)] {{(pid=115877) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:34:02.858199 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 265/540] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:02 2021] GET /compute/v2.1/servers/b5fbde14-9db9-42a1-ad66-7a9510756fa9 => generated 1279 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:03.064251 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-1fb687e2-263d-4949-8f67-754a0a66f3a9 req-31af4a4d-64f4-47e6-8129-60d65d001def service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6a3a830-8175-434e-8c23-336ccacf7ef8", "name": "network-vif-plugged", "status": "completed", "tag": "fd7216a9-4fe8-4770-a641-9f1115f86217"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:34:03.068172 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:34:03.068172 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:34:03.078920 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-1fb687e2-263d-4949-8f67-754a0a66f3a9 req-31af4a4d-64f4-47e6-8129-60d65d001def service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:03.079709 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-1fb687e2-263d-4949-8f67-754a0a66f3a9 req-31af4a4d-64f4-47e6-8129-60d65d001def service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:03.091853 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-1fb687e2-263d-4949-8f67-754a0a66f3a9 req-31af4a4d-64f4-47e6-8129-60d65d001def service nova] Creating event network-vif-plugged:fd7216a9-4fe8-4770-a641-9f1115f86217 for instance f6a3a830-8175-434e-8c23-336ccacf7ef8 on hv-cinder-81514 Oct 28 12:34:03.097680 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-1fb687e2-263d-4949-8f67-754a0a66f3a9 req-31af4a4d-64f4-47e6-8129-60d65d001def service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038400 Oct 28 12:34:03.098286 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 266/541] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:34:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:34:03.199264 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-a828ab7b-9bd7-432c-993b-82f1e7246071 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:03.200150 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-a828ab7b-9bd7-432c-993b-82f1e7246071 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:03.207301 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a828ab7b-9bd7-432c-993b-82f1e7246071 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:03.207887 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a828ab7b-9bd7-432c-993b-82f1e7246071 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:03.208702 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a828ab7b-9bd7-432c-993b-82f1e7246071 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:03.209344 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a828ab7b-9bd7-432c-993b-82f1e7246071 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:03.504067 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-a828ab7b-9bd7-432c-993b-82f1e7246071 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:03.511938 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-554cad96-983b-4d9d-86ee-97dce2d6b3ce tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Flavor limits 0:0:0 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:34:03.513565 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-554cad96-983b-4d9d-86ee-97dce2d6b3ce tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Image limits 0:0:0 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:34:03.514770 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-a828ab7b-9bd7-432c-993b-82f1e7246071 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:03.515365 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-554cad96-983b-4d9d-86ee-97dce2d6b3ce tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Flavor pref 0:0:0 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:34:03.516007 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-554cad96-983b-4d9d-86ee-97dce2d6b3ce tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Image pref 0:0:0 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:34:03.517278 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-554cad96-983b-4d9d-86ee-97dce2d6b3ce tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:34:03.518007 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-a828ab7b-9bd7-432c-993b-82f1e7246071 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:03.520455 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-a828ab7b-9bd7-432c-993b-82f1e7246071 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1809 microversion: 2.20 time: 0.324867 Oct 28 12:34:03.531225 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 267/542] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:34:03 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1809 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:34:03.532852 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-554cad96-983b-4d9d-86ee-97dce2d6b3ce tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:03.534680 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-554cad96-983b-4d9d-86ee-97dce2d6b3ce tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:03.535635 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-554cad96-983b-4d9d-86ee-97dce2d6b3ce tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:03.536070 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-554cad96-983b-4d9d-86ee-97dce2d6b3ce tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:03.553875 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.quota [None req-554cad96-983b-4d9d-86ee-97dce2d6b3ce tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Getting quotas for project 36003ac4ee5e4de5b4ef1ed104c55b6c. Resources: {'cores', 'instances', 'ram'} {{(pid=115877) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:34:03.558209 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.quota [None req-554cad96-983b-4d9d-86ee-97dce2d6b3ce tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Getting quotas for user ec86adff43114c36a65f2bb590e4f6e8 and project 36003ac4ee5e4de5b4ef1ed104c55b6c. Resources: {'cores', 'instances', 'ram'} {{(pid=115877) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:34:03.569602 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-554cad96-983b-4d9d-86ee-97dce2d6b3ce tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Going to run 1 instances... {{(pid=115877) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:34:03.572002 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-554cad96-983b-4d9d-86ee-97dce2d6b3ce tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: c8647488-6b19-46a6-a95e-7280a2f63c58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='575f28c8-0af2-4973-b3d9-a249e2400c6e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:34:03.619646 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-554cad96-983b-4d9d-86ee-97dce2d6b3ce tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.040332 Oct 28 12:34:03.620628 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 276/543] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Oct 28 12:34:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 1042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 12:34:03.632041 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-80ca25ff-4b42-4c97-aea6-111f46117cae tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:03.633011 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-80ca25ff-4b42-4c97-aea6-111f46117cae tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: c8647488-6b19-46a6-a95e-7280a2f63c58] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:03.700391 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-80ca25ff-4b42-4c97-aea6-111f46117cae tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:03.709514 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-80ca25ff-4b42-4c97-aea6-111f46117cae tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58" status: 200 len: 1217 microversion: 2.1 time: 0.081971 Oct 28 12:34:03.710301 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 268/544] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:03 2021] GET /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:34:03.872194 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-e94bb9e6-c329-4f57-bf81-398ea3b6a074 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:03.873508 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-e94bb9e6-c329-4f57-bf81-398ea3b6a074 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: b5fbde14-9db9-42a1-ad66-7a9510756fa9] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:03.886583 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e94bb9e6-c329-4f57-bf81-398ea3b6a074 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:03.887017 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e94bb9e6-c329-4f57-bf81-398ea3b6a074 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:03.888470 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e94bb9e6-c329-4f57-bf81-398ea3b6a074 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:03.889314 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e94bb9e6-c329-4f57-bf81-398ea3b6a074 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:04.166044 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-e94bb9e6-c329-4f57-bf81-398ea3b6a074 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a27389ddb44f893f2975cab49ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94643fb6f71b47f79d194ad0849be625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:04.173311 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-e94bb9e6-c329-4f57-bf81-398ea3b6a074 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "GET /compute/v2.1/servers/b5fbde14-9db9-42a1-ad66-7a9510756fa9" status: 200 len: 1319 microversion: 2.1 time: 0.307541 Oct 28 12:34:04.174049 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 277/545] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:03 2021] GET /compute/v2.1/servers/b5fbde14-9db9-42a1-ad66-7a9510756fa9 => generated 1319 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:34:04.539912 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-41480050-2677-4d29-8767-36a5431cae8f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:04.540519 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-41480050-2677-4d29-8767-36a5431cae8f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:04.547781 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-41480050-2677-4d29-8767-36a5431cae8f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:04.548218 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-41480050-2677-4d29-8767-36a5431cae8f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:04.549049 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-41480050-2677-4d29-8767-36a5431cae8f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:04.549591 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-41480050-2677-4d29-8767-36a5431cae8f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:04.729435 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-65e33c1b-ae3c-4267-9a11-9b9f90e4ceb3 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:04.730665 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-65e33c1b-ae3c-4267-9a11-9b9f90e4ceb3 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: c8647488-6b19-46a6-a95e-7280a2f63c58] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:04.739357 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-65e33c1b-ae3c-4267-9a11-9b9f90e4ceb3 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:04.740214 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-65e33c1b-ae3c-4267-9a11-9b9f90e4ceb3 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:04.742535 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-65e33c1b-ae3c-4267-9a11-9b9f90e4ceb3 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:04.743248 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-65e33c1b-ae3c-4267-9a11-9b9f90e4ceb3 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:04.760412 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-41480050-2677-4d29-8767-36a5431cae8f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:04.770952 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-41480050-2677-4d29-8767-36a5431cae8f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:04.773749 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-41480050-2677-4d29-8767-36a5431cae8f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:04.775132 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-41480050-2677-4d29-8767-36a5431cae8f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1809 microversion: 2.20 time: 0.240646 Oct 28 12:34:04.776971 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 269/546] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:34:04 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1809 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:34:04.867177 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-65e33c1b-ae3c-4267-9a11-9b9f90e4ceb3 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:04.893996 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-65e33c1b-ae3c-4267-9a11-9b9f90e4ceb3 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58" status: 200 len: 1277 microversion: 2.1 time: 0.170787 Oct 28 12:34:04.894754 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 278/547] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:04 2021] GET /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58 => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:04.955078 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-b950ab5c-f97f-4624-95ff-365777e73aec req-a75ac860-116d-4773-afda-4b1e290bf0cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5fbde14-9db9-42a1-ad66-7a9510756fa9", "tag": "35a1fc7b-548a-4aa4-a3c2-6662f685c0df"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:34:04.956575 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:34:04.956575 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:34:04.969961 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-b950ab5c-f97f-4624-95ff-365777e73aec req-a75ac860-116d-4773-afda-4b1e290bf0cb service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:04.970436 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-b950ab5c-f97f-4624-95ff-365777e73aec req-a75ac860-116d-4773-afda-4b1e290bf0cb service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:04.989292 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-b950ab5c-f97f-4624-95ff-365777e73aec req-a75ac860-116d-4773-afda-4b1e290bf0cb service nova] Creating event network-changed:35a1fc7b-548a-4aa4-a3c2-6662f685c0df for instance b5fbde14-9db9-42a1-ad66-7a9510756fa9 on hv-cinder-81514 Oct 28 12:34:04.996367 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-b950ab5c-f97f-4624-95ff-365777e73aec req-a75ac860-116d-4773-afda-4b1e290bf0cb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044772 Oct 28 12:34:04.997354 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 270/548] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:34:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:34:05.190959 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-b5c050eb-a9c9-492e-8616-5820f78ba329 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:05.191566 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-b5c050eb-a9c9-492e-8616-5820f78ba329 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: b5fbde14-9db9-42a1-ad66-7a9510756fa9] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:05.197905 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b5c050eb-a9c9-492e-8616-5820f78ba329 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:05.198576 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b5c050eb-a9c9-492e-8616-5820f78ba329 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:05.199534 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b5c050eb-a9c9-492e-8616-5820f78ba329 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:05.200121 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b5c050eb-a9c9-492e-8616-5820f78ba329 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:05.429378 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-b5c050eb-a9c9-492e-8616-5820f78ba329 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a27389ddb44f893f2975cab49ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94643fb6f71b47f79d194ad0849be625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:05.438958 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-b5c050eb-a9c9-492e-8616-5820f78ba329 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "GET /compute/v2.1/servers/b5fbde14-9db9-42a1-ad66-7a9510756fa9" status: 200 len: 1319 microversion: 2.1 time: 0.251624 Oct 28 12:34:05.439557 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 279/549] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:05 2021] GET /compute/v2.1/servers/b5fbde14-9db9-42a1-ad66-7a9510756fa9 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:05.793898 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-032b0a46-cc2b-4840-90fe-9ebddd85f8e1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:05.794758 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-032b0a46-cc2b-4840-90fe-9ebddd85f8e1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:05.801603 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-032b0a46-cc2b-4840-90fe-9ebddd85f8e1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:05.802253 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-032b0a46-cc2b-4840-90fe-9ebddd85f8e1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:05.804966 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-032b0a46-cc2b-4840-90fe-9ebddd85f8e1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:05.804966 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-032b0a46-cc2b-4840-90fe-9ebddd85f8e1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:05.912432 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-193d3ced-4c19-4fe5-974d-5a46865b0a54 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:05.914261 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-193d3ced-4c19-4fe5-974d-5a46865b0a54 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: c8647488-6b19-46a6-a95e-7280a2f63c58] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:05.921620 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-193d3ced-4c19-4fe5-974d-5a46865b0a54 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:05.922742 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-193d3ced-4c19-4fe5-974d-5a46865b0a54 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:05.923926 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-193d3ced-4c19-4fe5-974d-5a46865b0a54 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:05.924681 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-193d3ced-4c19-4fe5-974d-5a46865b0a54 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:06.106428 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-032b0a46-cc2b-4840-90fe-9ebddd85f8e1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:06.115410 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-032b0a46-cc2b-4840-90fe-9ebddd85f8e1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:06.117479 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-032b0a46-cc2b-4840-90fe-9ebddd85f8e1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:06.118818 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-032b0a46-cc2b-4840-90fe-9ebddd85f8e1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1809 microversion: 2.20 time: 0.328988 Oct 28 12:34:06.119408 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 271/550] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:34:05 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1809 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:34:06.187686 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-193d3ced-4c19-4fe5-974d-5a46865b0a54 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:06.195435 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-193d3ced-4c19-4fe5-974d-5a46865b0a54 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58" status: 200 len: 1317 microversion: 2.1 time: 0.287071 Oct 28 12:34:06.195997 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 280/551] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:05 2021] GET /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58 => generated 1317 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:06.456815 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-d72c1fb5-9116-4cad-aead-ceeb6e2f6226 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:06.457475 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-d72c1fb5-9116-4cad-aead-ceeb6e2f6226 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: b5fbde14-9db9-42a1-ad66-7a9510756fa9] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:06.464106 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d72c1fb5-9116-4cad-aead-ceeb6e2f6226 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:06.464837 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d72c1fb5-9116-4cad-aead-ceeb6e2f6226 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:06.465692 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d72c1fb5-9116-4cad-aead-ceeb6e2f6226 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:06.466202 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d72c1fb5-9116-4cad-aead-ceeb6e2f6226 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:06.541454 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-8078686a-d1d5-4172-8919-1979230fcae6 req-1ebb7d4b-e70c-459a-8476-b9ed29f301ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8647488-6b19-46a6-a95e-7280a2f63c58", "tag": "7ce9b0c6-a42a-4be7-bfa3-19f0694292ee"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:34:06.543407 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:34:06.543407 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:34:06.556861 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-8078686a-d1d5-4172-8919-1979230fcae6 req-1ebb7d4b-e70c-459a-8476-b9ed29f301ba service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:06.557295 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-8078686a-d1d5-4172-8919-1979230fcae6 req-1ebb7d4b-e70c-459a-8476-b9ed29f301ba service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:06.572267 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-8078686a-d1d5-4172-8919-1979230fcae6 req-1ebb7d4b-e70c-459a-8476-b9ed29f301ba service nova] Creating event network-changed:7ce9b0c6-a42a-4be7-bfa3-19f0694292ee for instance c8647488-6b19-46a6-a95e-7280a2f63c58 on hv-cinder-81514 Oct 28 12:34:06.577527 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-8078686a-d1d5-4172-8919-1979230fcae6 req-1ebb7d4b-e70c-459a-8476-b9ed29f301ba service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039780 Oct 28 12:34:06.578565 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 281/552] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:34:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:34:06.624307 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-d72c1fb5-9116-4cad-aead-ceeb6e2f6226 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a27389ddb44f893f2975cab49ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94643fb6f71b47f79d194ad0849be625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:06.631906 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-d72c1fb5-9116-4cad-aead-ceeb6e2f6226 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "GET /compute/v2.1/servers/b5fbde14-9db9-42a1-ad66-7a9510756fa9" status: 200 len: 1319 microversion: 2.1 time: 0.179340 Oct 28 12:34:06.632469 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 272/553] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:06 2021] GET /compute/v2.1/servers/b5fbde14-9db9-42a1-ad66-7a9510756fa9 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:06.861108 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-b63f96ef-7481-4926-a23a-c25df0362b33 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:06.861673 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-b63f96ef-7481-4926-a23a-c25df0362b33 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:06.869790 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b63f96ef-7481-4926-a23a-c25df0362b33 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:06.870271 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b63f96ef-7481-4926-a23a-c25df0362b33 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:06.871346 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b63f96ef-7481-4926-a23a-c25df0362b33 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:06.872172 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b63f96ef-7481-4926-a23a-c25df0362b33 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:07.010909 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.objects.instance [None req-b63f96ef-7481-4926-a23a-c25df0362b33 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lazy-loading 'services' on Instance uuid 1b133627-e4a2-43dc-9613-8ef3d028862b {{(pid=115877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:34:07.137063 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-b63f96ef-7481-4926-a23a-c25df0362b33 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "DELETE /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/os-volume_attachments/6ad11f67-ae87-43c8-9650-5b2f3ae8f110" status: 202 len: 0 microversion: 2.1 time: 0.280108 Oct 28 12:34:07.138208 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 282/554] 10.222.0.62 () {58 vars in 1415 bytes} [Thu Oct 28 12:34:06 2021] DELETE /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/os-volume_attachments/6ad11f67-ae87-43c8-9650-5b2f3ae8f110 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:34:07.139226 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-cd141cda-d1d7-4c70-b25e-d9c9d3b882ec tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:07.139889 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-cd141cda-d1d7-4c70-b25e-d9c9d3b882ec tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:07.150081 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cd141cda-d1d7-4c70-b25e-d9c9d3b882ec tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:07.150898 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cd141cda-d1d7-4c70-b25e-d9c9d3b882ec tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:07.151881 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cd141cda-d1d7-4c70-b25e-d9c9d3b882ec tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:07.152312 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cd141cda-d1d7-4c70-b25e-d9c9d3b882ec tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:07.214507 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-00e2ad1e-b479-437a-b9bd-0495e141739d tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:07.215908 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-00e2ad1e-b479-437a-b9bd-0495e141739d tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: c8647488-6b19-46a6-a95e-7280a2f63c58] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:07.223829 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-00e2ad1e-b479-437a-b9bd-0495e141739d tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:07.224343 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-00e2ad1e-b479-437a-b9bd-0495e141739d tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:07.225635 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-00e2ad1e-b479-437a-b9bd-0495e141739d tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:07.226070 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-00e2ad1e-b479-437a-b9bd-0495e141739d tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:07.337071 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-cd141cda-d1d7-4c70-b25e-d9c9d3b882ec tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:07.348801 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-cd141cda-d1d7-4c70-b25e-d9c9d3b882ec tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:07.350514 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-cd141cda-d1d7-4c70-b25e-d9c9d3b882ec tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:07.351807 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-cd141cda-d1d7-4c70-b25e-d9c9d3b882ec tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1796 microversion: 2.20 time: 0.217921 Oct 28 12:34:07.356435 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 273/555] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:34:07 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1796 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:34:07.404351 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-00e2ad1e-b479-437a-b9bd-0495e141739d tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:07.412947 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-00e2ad1e-b479-437a-b9bd-0495e141739d tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58" status: 200 len: 1317 microversion: 2.1 time: 0.203087 Oct 28 12:34:07.413629 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 283/556] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:07 2021] GET /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58 => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:34:07.648963 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-5b66babe-be5a-418d-9265-6bc960041e8d tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:07.649447 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-5b66babe-be5a-418d-9265-6bc960041e8d tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: b5fbde14-9db9-42a1-ad66-7a9510756fa9] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:07.655827 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5b66babe-be5a-418d-9265-6bc960041e8d tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:07.656260 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5b66babe-be5a-418d-9265-6bc960041e8d tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:07.657067 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5b66babe-be5a-418d-9265-6bc960041e8d tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:07.657489 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5b66babe-be5a-418d-9265-6bc960041e8d tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:07.792555 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-5b66babe-be5a-418d-9265-6bc960041e8d tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a27389ddb44f893f2975cab49ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94643fb6f71b47f79d194ad0849be625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:07.800283 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-5b66babe-be5a-418d-9265-6bc960041e8d tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "GET /compute/v2.1/servers/b5fbde14-9db9-42a1-ad66-7a9510756fa9" status: 200 len: 1319 microversion: 2.1 time: 0.155173 Oct 28 12:34:07.800882 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 274/557] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:07 2021] GET /compute/v2.1/servers/b5fbde14-9db9-42a1-ad66-7a9510756fa9 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:08.302334 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-f7a4b41f-bd00-4422-ab53-21e82a939934 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:34:08.309969 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f7a4b41f-bd00-4422-ab53-21e82a939934 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:08.310540 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f7a4b41f-bd00-4422-ab53-21e82a939934 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:08.335334 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-f7a4b41f-bd00-4422-ab53-21e82a939934 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Going to try to stop instance {{(pid=115877) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Oct 28 12:34:08.380967 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-f7a4b41f-bd00-4422-ab53-21e82a939934 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 202 len: 0 microversion: 2.1 time: 0.082242 Oct 28 12:34:08.381565 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 284/558] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:34:08 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:34:08.389461 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-578b8335-8869-4a2b-a229-711f55722d14 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:08.390052 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-578b8335-8869-4a2b-a229-711f55722d14 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:08.397134 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-578b8335-8869-4a2b-a229-711f55722d14 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:08.397684 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-578b8335-8869-4a2b-a229-711f55722d14 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:08.398468 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-578b8335-8869-4a2b-a229-711f55722d14 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:08.398925 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-578b8335-8869-4a2b-a229-711f55722d14 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:08.433836 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-1f952779-0670-49f6-8024-18bb916492f3 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:08.434861 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-1f952779-0670-49f6-8024-18bb916492f3 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: c8647488-6b19-46a6-a95e-7280a2f63c58] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:08.443109 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1f952779-0670-49f6-8024-18bb916492f3 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:08.443569 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1f952779-0670-49f6-8024-18bb916492f3 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:08.444515 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1f952779-0670-49f6-8024-18bb916492f3 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:08.444977 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1f952779-0670-49f6-8024-18bb916492f3 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:08.570239 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-578b8335-8869-4a2b-a229-711f55722d14 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:08.578850 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-578b8335-8869-4a2b-a229-711f55722d14 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1675 microversion: 2.1 time: 0.193033 Oct 28 12:34:08.579685 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 275/559] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:08 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1675 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:08.605707 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-1f952779-0670-49f6-8024-18bb916492f3 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:08.613781 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-1f952779-0670-49f6-8024-18bb916492f3 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58" status: 200 len: 1317 microversion: 2.1 time: 0.186295 Oct 28 12:34:08.614353 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 285/560] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:08 2021] GET /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:08.819106 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-998140bd-1f24-407e-a106-6ec917f53ae3 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:08.819655 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-998140bd-1f24-407e-a106-6ec917f53ae3 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: b5fbde14-9db9-42a1-ad66-7a9510756fa9] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:08.825907 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-998140bd-1f24-407e-a106-6ec917f53ae3 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:08.826351 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-998140bd-1f24-407e-a106-6ec917f53ae3 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:08.827116 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-998140bd-1f24-407e-a106-6ec917f53ae3 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:08.827543 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-998140bd-1f24-407e-a106-6ec917f53ae3 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:08.965213 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-998140bd-1f24-407e-a106-6ec917f53ae3 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a27389ddb44f893f2975cab49ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94643fb6f71b47f79d194ad0849be625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:08.972808 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-998140bd-1f24-407e-a106-6ec917f53ae3 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "GET /compute/v2.1/servers/b5fbde14-9db9-42a1-ad66-7a9510756fa9" status: 200 len: 1319 microversion: 2.1 time: 0.158163 Oct 28 12:34:08.973360 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 276/561] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:08 2021] GET /compute/v2.1/servers/b5fbde14-9db9-42a1-ad66-7a9510756fa9 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:09.219496 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-9a3d1afb-93e2-479e-958d-30490031a28a req-fa28bdb0-d441-48aa-a89f-9305bb1cf417 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5fbde14-9db9-42a1-ad66-7a9510756fa9", "name": "network-vif-plugged", "status": "completed", "tag": "35a1fc7b-548a-4aa4-a3c2-6662f685c0df"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:34:09.221328 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:34:09.221328 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:34:09.228306 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-9a3d1afb-93e2-479e-958d-30490031a28a req-fa28bdb0-d441-48aa-a89f-9305bb1cf417 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:09.228776 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-9a3d1afb-93e2-479e-958d-30490031a28a req-fa28bdb0-d441-48aa-a89f-9305bb1cf417 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:09.241645 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-9a3d1afb-93e2-479e-958d-30490031a28a req-fa28bdb0-d441-48aa-a89f-9305bb1cf417 service nova] Creating event network-vif-plugged:35a1fc7b-548a-4aa4-a3c2-6662f685c0df for instance b5fbde14-9db9-42a1-ad66-7a9510756fa9 on hv-cinder-81514 Oct 28 12:34:09.246975 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-9a3d1afb-93e2-479e-958d-30490031a28a req-fa28bdb0-d441-48aa-a89f-9305bb1cf417 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031771 Oct 28 12:34:09.247908 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 286/562] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:34:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:34:09.596985 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-9fce957f-e7ac-4a0f-b8e4-ded2a4c7536c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:09.597579 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-9fce957f-e7ac-4a0f-b8e4-ded2a4c7536c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:09.604399 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9fce957f-e7ac-4a0f-b8e4-ded2a4c7536c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:09.604881 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9fce957f-e7ac-4a0f-b8e4-ded2a4c7536c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:09.605672 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9fce957f-e7ac-4a0f-b8e4-ded2a4c7536c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:09.606067 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9fce957f-e7ac-4a0f-b8e4-ded2a4c7536c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:09.635825 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-9303e3cd-a023-4cba-9c4c-6fe533b26300 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:09.637272 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-9303e3cd-a023-4cba-9c4c-6fe533b26300 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: c8647488-6b19-46a6-a95e-7280a2f63c58] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:09.645820 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9303e3cd-a023-4cba-9c4c-6fe533b26300 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:09.646269 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9303e3cd-a023-4cba-9c4c-6fe533b26300 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:09.647052 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9303e3cd-a023-4cba-9c4c-6fe533b26300 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:09.647470 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9303e3cd-a023-4cba-9c4c-6fe533b26300 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:09.788737 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-9fce957f-e7ac-4a0f-b8e4-ded2a4c7536c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:09.797579 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-9fce957f-e7ac-4a0f-b8e4-ded2a4c7536c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1675 microversion: 2.1 time: 0.204442 Oct 28 12:34:09.798198 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 277/563] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:09 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1675 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:09.817805 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-9303e3cd-a023-4cba-9c4c-6fe533b26300 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:09.825692 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-9303e3cd-a023-4cba-9c4c-6fe533b26300 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58" status: 200 len: 1317 microversion: 2.1 time: 0.196656 Oct 28 12:34:09.826242 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 287/564] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:09 2021] GET /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58 => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:09.989557 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-14d584fd-a40e-401c-9911-45457db2a56b tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:09.990214 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-14d584fd-a40e-401c-9911-45457db2a56b tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: b5fbde14-9db9-42a1-ad66-7a9510756fa9] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:09.997774 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-14d584fd-a40e-401c-9911-45457db2a56b tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:09.998210 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-14d584fd-a40e-401c-9911-45457db2a56b tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:09.998970 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-14d584fd-a40e-401c-9911-45457db2a56b tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:09.999393 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-14d584fd-a40e-401c-9911-45457db2a56b tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:10.150881 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-14d584fd-a40e-401c-9911-45457db2a56b tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a27389ddb44f893f2975cab49ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94643fb6f71b47f79d194ad0849be625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:10.158793 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-14d584fd-a40e-401c-9911-45457db2a56b tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "GET /compute/v2.1/servers/b5fbde14-9db9-42a1-ad66-7a9510756fa9" status: 200 len: 1319 microversion: 2.1 time: 0.172927 Oct 28 12:34:10.159366 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 278/565] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:09 2021] GET /compute/v2.1/servers/b5fbde14-9db9-42a1-ad66-7a9510756fa9 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:10.816017 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-f06cce93-35fa-45e7-96bd-2bba8165e109 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:10.816634 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-f06cce93-35fa-45e7-96bd-2bba8165e109 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:10.823381 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f06cce93-35fa-45e7-96bd-2bba8165e109 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:10.823827 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f06cce93-35fa-45e7-96bd-2bba8165e109 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:10.824588 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f06cce93-35fa-45e7-96bd-2bba8165e109 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:10.825044 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f06cce93-35fa-45e7-96bd-2bba8165e109 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:10.842895 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-c2e1fa3a-c236-42d5-bbf5-a23eb38a2f28 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:10.843782 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-c2e1fa3a-c236-42d5-bbf5-a23eb38a2f28 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: c8647488-6b19-46a6-a95e-7280a2f63c58] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:10.850952 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c2e1fa3a-c236-42d5-bbf5-a23eb38a2f28 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:10.851397 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c2e1fa3a-c236-42d5-bbf5-a23eb38a2f28 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:10.853125 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c2e1fa3a-c236-42d5-bbf5-a23eb38a2f28 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:10.853125 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c2e1fa3a-c236-42d5-bbf5-a23eb38a2f28 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:11.022667 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-f06cce93-35fa-45e7-96bd-2bba8165e109 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:11.028082 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-c2e1fa3a-c236-42d5-bbf5-a23eb38a2f28 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:11.033535 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-f06cce93-35fa-45e7-96bd-2bba8165e109 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1675 microversion: 2.1 time: 0.221676 Oct 28 12:34:11.034583 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 288/566] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:10 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1675 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:11.041575 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-c2e1fa3a-c236-42d5-bbf5-a23eb38a2f28 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58" status: 200 len: 1317 microversion: 2.1 time: 0.202027 Oct 28 12:34:11.046668 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 279/567] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:10 2021] GET /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58 => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:11.177960 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-a94665b9-97a6-4a11-83cb-981bc1b0c118 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:11.178682 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-a94665b9-97a6-4a11-83cb-981bc1b0c118 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: b5fbde14-9db9-42a1-ad66-7a9510756fa9] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:11.187046 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a94665b9-97a6-4a11-83cb-981bc1b0c118 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:11.187564 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a94665b9-97a6-4a11-83cb-981bc1b0c118 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:11.188534 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a94665b9-97a6-4a11-83cb-981bc1b0c118 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:11.188993 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a94665b9-97a6-4a11-83cb-981bc1b0c118 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:11.270940 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-c0af16ce-2219-417b-b638-65cb81acca3d req-33dbcbf8-ee83-4d6b-9830-b0283efe3ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8647488-6b19-46a6-a95e-7280a2f63c58", "name": "network-vif-plugged", "status": "completed", "tag": "7ce9b0c6-a42a-4be7-bfa3-19f0694292ee"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:34:11.274204 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:34:11.274204 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:34:11.283887 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-c0af16ce-2219-417b-b638-65cb81acca3d req-33dbcbf8-ee83-4d6b-9830-b0283efe3ad1 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:11.284412 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-c0af16ce-2219-417b-b638-65cb81acca3d req-33dbcbf8-ee83-4d6b-9830-b0283efe3ad1 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:11.297296 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-c0af16ce-2219-417b-b638-65cb81acca3d req-33dbcbf8-ee83-4d6b-9830-b0283efe3ad1 service nova] Creating event network-vif-plugged:7ce9b0c6-a42a-4be7-bfa3-19f0694292ee for instance c8647488-6b19-46a6-a95e-7280a2f63c58 on hv-cinder-81514 Oct 28 12:34:11.302302 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-c0af16ce-2219-417b-b638-65cb81acca3d req-33dbcbf8-ee83-4d6b-9830-b0283efe3ad1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038268 Oct 28 12:34:11.303087 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 280/568] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:34:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:34:11.327230 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-a94665b9-97a6-4a11-83cb-981bc1b0c118 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a27389ddb44f893f2975cab49ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94643fb6f71b47f79d194ad0849be625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:11.335146 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-a94665b9-97a6-4a11-83cb-981bc1b0c118 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "GET /compute/v2.1/servers/b5fbde14-9db9-42a1-ad66-7a9510756fa9" status: 200 len: 1508 microversion: 2.1 time: 0.161049 Oct 28 12:34:11.335814 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 289/569] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:11 2021] GET /compute/v2.1/servers/b5fbde14-9db9-42a1-ad66-7a9510756fa9 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:11.358364 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-40c36dae-1b57-4ddf-99ef-2dbc89c6b4df tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c62ed946-cc7e-4168-9f02-e62d1a8b1748", "device": "/dev/sdb"}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:34:11.359476 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-40c36dae-1b57-4ddf-99ef-2dbc89c6b4df tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: b5fbde14-9db9-42a1-ad66-7a9510756fa9] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:11.366167 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-40c36dae-1b57-4ddf-99ef-2dbc89c6b4df tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:11.366605 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-40c36dae-1b57-4ddf-99ef-2dbc89c6b4df tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:11.367436 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-40c36dae-1b57-4ddf-99ef-2dbc89c6b4df tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:11.368275 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-40c36dae-1b57-4ddf-99ef-2dbc89c6b4df tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:11.628204 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-40c36dae-1b57-4ddf-99ef-2dbc89c6b4df tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "POST /compute/v2.1/servers/b5fbde14-9db9-42a1-ad66-7a9510756fa9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274492 Oct 28 12:34:11.628729 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 281/570] 10.222.0.62 () {60 vars in 1322 bytes} [Thu Oct 28 12:34:11 2021] POST /compute/v2.1/servers/b5fbde14-9db9-42a1-ad66-7a9510756fa9/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:34:12.051455 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-fa7cce22-444d-49d7-9144-8097de28e4b6 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:12.052031 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-fa7cce22-444d-49d7-9144-8097de28e4b6 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:12.059566 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fa7cce22-444d-49d7-9144-8097de28e4b6 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:12.060065 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fa7cce22-444d-49d7-9144-8097de28e4b6 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:12.060989 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fa7cce22-444d-49d7-9144-8097de28e4b6 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:12.061447 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fa7cce22-444d-49d7-9144-8097de28e4b6 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:12.069838 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-1ae7aa20-7739-4ed4-9a9e-090f79694328 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:12.070738 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-1ae7aa20-7739-4ed4-9a9e-090f79694328 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: c8647488-6b19-46a6-a95e-7280a2f63c58] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:12.078345 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1ae7aa20-7739-4ed4-9a9e-090f79694328 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:12.078780 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1ae7aa20-7739-4ed4-9a9e-090f79694328 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:12.079546 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1ae7aa20-7739-4ed4-9a9e-090f79694328 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:12.079968 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1ae7aa20-7739-4ed4-9a9e-090f79694328 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:12.257603 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-fa7cce22-444d-49d7-9144-8097de28e4b6 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:12.262561 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-1ae7aa20-7739-4ed4-9a9e-090f79694328 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:12.265491 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-fa7cce22-444d-49d7-9144-8097de28e4b6 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1675 microversion: 2.1 time: 0.217755 Oct 28 12:34:12.266243 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 290/571] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:12 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1675 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:12.270253 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-1ae7aa20-7739-4ed4-9a9e-090f79694328 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58" status: 200 len: 1317 microversion: 2.1 time: 0.206539 Oct 28 12:34:12.270914 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 282/572] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:12 2021] GET /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58 => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:13.283654 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-8600aaa8-73d5-4c3e-8d26-be9185680723 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:13.284218 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-8600aaa8-73d5-4c3e-8d26-be9185680723 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:13.286955 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-e17c607f-4c52-4407-a842-5084fd31f3da tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:13.287837 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-e17c607f-4c52-4407-a842-5084fd31f3da tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: c8647488-6b19-46a6-a95e-7280a2f63c58] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:13.290777 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8600aaa8-73d5-4c3e-8d26-be9185680723 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:13.291218 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8600aaa8-73d5-4c3e-8d26-be9185680723 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:13.291990 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8600aaa8-73d5-4c3e-8d26-be9185680723 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:13.292419 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8600aaa8-73d5-4c3e-8d26-be9185680723 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:13.294549 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e17c607f-4c52-4407-a842-5084fd31f3da tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:13.294981 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e17c607f-4c52-4407-a842-5084fd31f3da tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:13.295745 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e17c607f-4c52-4407-a842-5084fd31f3da tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:13.296206 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e17c607f-4c52-4407-a842-5084fd31f3da tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:13.478065 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-8600aaa8-73d5-4c3e-8d26-be9185680723 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:13.486520 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-e17c607f-4c52-4407-a842-5084fd31f3da tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:13.486994 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-8600aaa8-73d5-4c3e-8d26-be9185680723 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1675 microversion: 2.1 time: 0.207098 Oct 28 12:34:13.487552 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 291/573] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:13 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1675 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:13.495018 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-e17c607f-4c52-4407-a842-5084fd31f3da tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58" status: 200 len: 1506 microversion: 2.1 time: 0.211758 Oct 28 12:34:13.495570 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 283/574] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:13 2021] GET /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58 => generated 1506 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:14.503396 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-1cb2bc93-674c-4157-83bb-a11e0a90013c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:14.503984 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-1cb2bc93-674c-4157-83bb-a11e0a90013c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:14.512149 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1cb2bc93-674c-4157-83bb-a11e0a90013c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:14.512984 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1cb2bc93-674c-4157-83bb-a11e0a90013c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:14.514192 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1cb2bc93-674c-4157-83bb-a11e0a90013c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:14.515065 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1cb2bc93-674c-4157-83bb-a11e0a90013c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:14.648623 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-1cb2bc93-674c-4157-83bb-a11e0a90013c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:14.657918 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-1cb2bc93-674c-4157-83bb-a11e0a90013c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1675 microversion: 2.1 time: 0.158276 Oct 28 12:34:14.657918 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 292/575] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:14 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:14.865304 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-7c0ea276-d4b4-46ca-b622-b257eefc8989 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11e8c430-23d7-44a1-9cdb-089b366a34a6"}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:34:14.866349 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-7c0ea276-d4b4-46ca-b622-b257eefc8989 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: c8647488-6b19-46a6-a95e-7280a2f63c58] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:14.874721 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7c0ea276-d4b4-46ca-b622-b257eefc8989 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:14.875163 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7c0ea276-d4b4-46ca-b622-b257eefc8989 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:14.875921 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7c0ea276-d4b4-46ca-b622-b257eefc8989 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:14.876344 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7c0ea276-d4b4-46ca-b622-b257eefc8989 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:15.136091 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-7c0ea276-d4b4-46ca-b622-b257eefc8989 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "POST /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274416 Oct 28 12:34:15.136804 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 284/576] 10.222.0.62 () {60 vars in 1322 bytes} [Thu Oct 28 12:34:14 2021] POST /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:34:15.675573 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-8686daef-d772-4cc7-acc5-b703325fd879 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:15.676195 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-8686daef-d772-4cc7-acc5-b703325fd879 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:15.683308 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8686daef-d772-4cc7-acc5-b703325fd879 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:15.683815 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8686daef-d772-4cc7-acc5-b703325fd879 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:15.684577 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8686daef-d772-4cc7-acc5-b703325fd879 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:15.685047 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8686daef-d772-4cc7-acc5-b703325fd879 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:15.813439 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-8686daef-d772-4cc7-acc5-b703325fd879 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:15.822309 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-8686daef-d772-4cc7-acc5-b703325fd879 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1675 microversion: 2.1 time: 0.150442 Oct 28 12:34:15.823759 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 293/577] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:15 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:16.844006 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-5fef2042-a40e-44e6-9a5d-5c79092d6967 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:16.844976 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-5fef2042-a40e-44e6-9a5d-5c79092d6967 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:16.854122 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5fef2042-a40e-44e6-9a5d-5c79092d6967 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:16.854739 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5fef2042-a40e-44e6-9a5d-5c79092d6967 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:16.855744 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5fef2042-a40e-44e6-9a5d-5c79092d6967 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:16.856315 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5fef2042-a40e-44e6-9a5d-5c79092d6967 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:16.860703 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 12:34:16.861001 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: Thu Oct 28 12:34:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b (ip 10.222.0.62) !!! Oct 28 12:34:17.007929 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-5fef2042-a40e-44e6-9a5d-5c79092d6967 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:17.015896 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-5fef2042-a40e-44e6-9a5d-5c79092d6967 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1675 microversion: 2.1 time: 0.177912 Oct 28 12:34:17.016458 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 285/578] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:16 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1675 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:18.033102 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-02d99fc7-880c-4ca2-9d07-2eeb157fffc7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:18.033665 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-02d99fc7-880c-4ca2-9d07-2eeb157fffc7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:18.040549 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-02d99fc7-880c-4ca2-9d07-2eeb157fffc7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:18.040984 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-02d99fc7-880c-4ca2-9d07-2eeb157fffc7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:18.041739 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-02d99fc7-880c-4ca2-9d07-2eeb157fffc7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:18.042146 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-02d99fc7-880c-4ca2-9d07-2eeb157fffc7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:18.179828 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-02d99fc7-880c-4ca2-9d07-2eeb157fffc7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:18.188030 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-02d99fc7-880c-4ca2-9d07-2eeb157fffc7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1675 microversion: 2.1 time: 0.158552 Oct 28 12:34:18.188603 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 294/579] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:18 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:19.205212 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-66df45ee-cc06-437f-8298-8ba87d60d3b7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:19.205870 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-66df45ee-cc06-437f-8298-8ba87d60d3b7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:19.213171 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-66df45ee-cc06-437f-8298-8ba87d60d3b7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:19.213609 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-66df45ee-cc06-437f-8298-8ba87d60d3b7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:19.214375 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-66df45ee-cc06-437f-8298-8ba87d60d3b7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:19.214800 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-66df45ee-cc06-437f-8298-8ba87d60d3b7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:19.342238 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-66df45ee-cc06-437f-8298-8ba87d60d3b7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:19.353834 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-66df45ee-cc06-437f-8298-8ba87d60d3b7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1652 microversion: 2.1 time: 0.152266 Oct 28 12:34:19.354407 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 286/580] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:19 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1652 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:19.373259 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-4dfa15b9-a92b-472b-b723-cbbb8b92b114 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:34:19.379913 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4dfa15b9-a92b-472b-b723-cbbb8b92b114 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:19.380457 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4dfa15b9-a92b-472b-b723-cbbb8b92b114 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:19.404153 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-4dfa15b9-a92b-472b-b723-cbbb8b92b114 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Going to try to start instance {{(pid=115877) start /opt/stack/nova/nova/compute/api.py:2675}} Oct 28 12:34:19.452811 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-4dfa15b9-a92b-472b-b723-cbbb8b92b114 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action" status: 202 len: 0 microversion: 2.1 time: 0.082886 Oct 28 12:34:19.453496 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 295/581] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:34:19 2021] POST /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:34:19.462767 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-2a430b1c-7058-4630-8c2b-3aecadc3cfbc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:19.463869 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-2a430b1c-7058-4630-8c2b-3aecadc3cfbc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:19.469878 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2a430b1c-7058-4630-8c2b-3aecadc3cfbc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:19.470446 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2a430b1c-7058-4630-8c2b-3aecadc3cfbc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:19.471234 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2a430b1c-7058-4630-8c2b-3aecadc3cfbc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:19.471746 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2a430b1c-7058-4630-8c2b-3aecadc3cfbc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:19.615068 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-2a430b1c-7058-4630-8c2b-3aecadc3cfbc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:19.624297 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-2a430b1c-7058-4630-8c2b-3aecadc3cfbc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1661 microversion: 2.1 time: 0.166194 Oct 28 12:34:19.624904 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 287/582] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:19 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1661 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:34:20.651505 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-183508e0-f18e-4641-abe1-e415507d8fb1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:20.652634 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-183508e0-f18e-4641-abe1-e415507d8fb1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:20.663100 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-183508e0-f18e-4641-abe1-e415507d8fb1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:20.663833 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-183508e0-f18e-4641-abe1-e415507d8fb1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:20.665157 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-183508e0-f18e-4641-abe1-e415507d8fb1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:20.665870 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-183508e0-f18e-4641-abe1-e415507d8fb1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:20.807453 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-183508e0-f18e-4641-abe1-e415507d8fb1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:20.815477 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-183508e0-f18e-4641-abe1-e415507d8fb1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1661 microversion: 2.1 time: 0.171668 Oct 28 12:34:20.816036 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 296/583] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:20 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1661 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:21.833461 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-f3f576fc-07f5-4f68-8cac-487c2155ba18 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:21.834333 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-f3f576fc-07f5-4f68-8cac-487c2155ba18 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:21.841052 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f3f576fc-07f5-4f68-8cac-487c2155ba18 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:21.841486 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f3f576fc-07f5-4f68-8cac-487c2155ba18 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:21.842242 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f3f576fc-07f5-4f68-8cac-487c2155ba18 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:21.842667 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f3f576fc-07f5-4f68-8cac-487c2155ba18 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:21.966238 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f3f576fc-07f5-4f68-8cac-487c2155ba18 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:21.973721 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-f3f576fc-07f5-4f68-8cac-487c2155ba18 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1661 microversion: 2.1 time: 0.144172 Oct 28 12:34:21.974254 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 288/584] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:21 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1661 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:22.991367 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-58fd1274-b322-4ef2-a383-232cf1a85e9a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:22.991969 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-58fd1274-b322-4ef2-a383-232cf1a85e9a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:22.998516 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-58fd1274-b322-4ef2-a383-232cf1a85e9a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:22.999182 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-58fd1274-b322-4ef2-a383-232cf1a85e9a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:22.999919 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-58fd1274-b322-4ef2-a383-232cf1a85e9a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:23.000341 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-58fd1274-b322-4ef2-a383-232cf1a85e9a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:23.127576 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-58fd1274-b322-4ef2-a383-232cf1a85e9a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:23.135028 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-58fd1274-b322-4ef2-a383-232cf1a85e9a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1661 microversion: 2.1 time: 0.147665 Oct 28 12:34:23.135587 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 297/585] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:22 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1661 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:24.153880 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-b273f50a-ace0-446e-b464-aea524d7f247 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:24.154472 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-b273f50a-ace0-446e-b464-aea524d7f247 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:24.161212 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b273f50a-ace0-446e-b464-aea524d7f247 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:24.161776 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b273f50a-ace0-446e-b464-aea524d7f247 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:24.162534 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b273f50a-ace0-446e-b464-aea524d7f247 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:24.162968 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b273f50a-ace0-446e-b464-aea524d7f247 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:24.290320 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-b273f50a-ace0-446e-b464-aea524d7f247 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:24.298302 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-b273f50a-ace0-446e-b464-aea524d7f247 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1665 microversion: 2.1 time: 0.148230 Oct 28 12:34:24.298871 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 289/586] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:24 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1665 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:27.956015 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-72d24059-de2a-41f6-a368-41f7971da068 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1321251615", "imageRef": "575f28c8-0af2-4973-b3d9-a249e2400c6e", "flavorRef": "452", "networks": [{"uuid": "e80a2853-2c5f-4e30-b57e-4bb32d36cb7b"}]}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:34:28.009185 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.network.neutron [None req-72d24059-de2a-41f6-a368-41f7971da068 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] validate_networks() for [('e80a2853-2c5f-4e30-b57e-4bb32d36cb7b', None, None, None, None, None)] {{(pid=115877) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:34:28.379671 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-72d24059-de2a-41f6-a368-41f7971da068 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Flavor limits 0:0:0 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:34:28.380091 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-72d24059-de2a-41f6-a368-41f7971da068 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Image limits 0:0:0 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:34:28.380659 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-72d24059-de2a-41f6-a368-41f7971da068 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Flavor pref 0:0:0 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:34:28.381128 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-72d24059-de2a-41f6-a368-41f7971da068 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Image pref 0:0:0 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:34:28.381535 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-72d24059-de2a-41f6-a368-41f7971da068 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:34:28.390847 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-72d24059-de2a-41f6-a368-41f7971da068 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:28.391292 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-72d24059-de2a-41f6-a368-41f7971da068 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:28.392099 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-72d24059-de2a-41f6-a368-41f7971da068 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:28.392528 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-72d24059-de2a-41f6-a368-41f7971da068 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:28.409147 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.quota [None req-72d24059-de2a-41f6-a368-41f7971da068 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Getting quotas for project 36003ac4ee5e4de5b4ef1ed104c55b6c. Resources: {'cores', 'instances', 'ram'} {{(pid=115877) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:34:28.413256 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.quota [None req-72d24059-de2a-41f6-a368-41f7971da068 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Getting quotas for user ec86adff43114c36a65f2bb590e4f6e8 and project 36003ac4ee5e4de5b4ef1ed104c55b6c. Resources: {'cores', 'instances', 'ram'} {{(pid=115877) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:34:28.424592 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-72d24059-de2a-41f6-a368-41f7971da068 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Going to run 1 instances... {{(pid=115877) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:34:28.426957 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-72d24059-de2a-41f6-a368-41f7971da068 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 251e6078-cf22-4b27-b53f-103c7a27e690] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='575f28c8-0af2-4973-b3d9-a249e2400c6e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:34:28.471139 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-72d24059-de2a-41f6-a368-41f7971da068 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.518759 Oct 28 12:34:28.471797 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 298/587] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Oct 28 12:34:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 12:34:28.481845 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-5c2441c1-bb03-4b70-9cd7-0c8303a59eb8 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:28.482455 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-5c2441c1-bb03-4b70-9cd7-0c8303a59eb8 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 251e6078-cf22-4b27-b53f-103c7a27e690] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:28.534119 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-5c2441c1-bb03-4b70-9cd7-0c8303a59eb8 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:28.540802 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-5c2441c1-bb03-4b70-9cd7-0c8303a59eb8 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/251e6078-cf22-4b27-b53f-103c7a27e690" status: 200 len: 1218 microversion: 2.1 time: 0.062876 Oct 28 12:34:28.541585 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 290/588] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:28 2021] GET /compute/v2.1/servers/251e6078-cf22-4b27-b53f-103c7a27e690 => generated 1218 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:29.559041 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-dde190f7-67de-4511-b3d4-a5600407a58a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:29.559790 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-dde190f7-67de-4511-b3d4-a5600407a58a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 251e6078-cf22-4b27-b53f-103c7a27e690] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:29.566438 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-dde190f7-67de-4511-b3d4-a5600407a58a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:29.566954 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-dde190f7-67de-4511-b3d4-a5600407a58a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:29.567883 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-dde190f7-67de-4511-b3d4-a5600407a58a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:29.568285 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-dde190f7-67de-4511-b3d4-a5600407a58a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:29.630210 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-dde190f7-67de-4511-b3d4-a5600407a58a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:29.638192 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-dde190f7-67de-4511-b3d4-a5600407a58a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/251e6078-cf22-4b27-b53f-103c7a27e690" status: 200 len: 1288 microversion: 2.1 time: 0.083870 Oct 28 12:34:29.638801 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 299/589] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:29 2021] GET /compute/v2.1/servers/251e6078-cf22-4b27-b53f-103c7a27e690 => generated 1288 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:30.655682 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-eec432b5-c6b8-4cba-9e56-d7d7415ad0ef tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:30.656286 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-eec432b5-c6b8-4cba-9e56-d7d7415ad0ef tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 251e6078-cf22-4b27-b53f-103c7a27e690] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:30.663377 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-eec432b5-c6b8-4cba-9e56-d7d7415ad0ef tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:30.663822 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-eec432b5-c6b8-4cba-9e56-d7d7415ad0ef tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:30.664590 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-eec432b5-c6b8-4cba-9e56-d7d7415ad0ef tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:30.665052 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-eec432b5-c6b8-4cba-9e56-d7d7415ad0ef tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:30.790845 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-efa6c03a-9723-40e2-a8a8-788243c267e1 req-8cadd84f-9643-4a96-a27b-e0ac8fda668d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "251e6078-cf22-4b27-b53f-103c7a27e690", "tag": "bdba618a-d033-41e3-9405-ac2e006dac09"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:34:30.793387 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:34:30.793387 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:34:30.802440 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-efa6c03a-9723-40e2-a8a8-788243c267e1 req-8cadd84f-9643-4a96-a27b-e0ac8fda668d service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:30.803360 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-efa6c03a-9723-40e2-a8a8-788243c267e1 req-8cadd84f-9643-4a96-a27b-e0ac8fda668d service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:30.810148 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-eec432b5-c6b8-4cba-9e56-d7d7415ad0ef tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:30.819987 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-eec432b5-c6b8-4cba-9e56-d7d7415ad0ef tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/251e6078-cf22-4b27-b53f-103c7a27e690" status: 200 len: 1318 microversion: 2.1 time: 0.168045 Oct 28 12:34:30.820619 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 291/590] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:30 2021] GET /compute/v2.1/servers/251e6078-cf22-4b27-b53f-103c7a27e690 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:30.836122 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-efa6c03a-9723-40e2-a8a8-788243c267e1 req-8cadd84f-9643-4a96-a27b-e0ac8fda668d service nova] Creating event network-changed:bdba618a-d033-41e3-9405-ac2e006dac09 for instance 251e6078-cf22-4b27-b53f-103c7a27e690 on hv-cinder-81514 Oct 28 12:34:30.841189 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-efa6c03a-9723-40e2-a8a8-788243c267e1 req-8cadd84f-9643-4a96-a27b-e0ac8fda668d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055828 Oct 28 12:34:30.841911 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 300/591] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:34:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:34:31.075180 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-58cc47ab-0a4f-4c22-9188-8638fd850a51 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:31.075665 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-58cc47ab-0a4f-4c22-9188-8638fd850a51 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: b5fbde14-9db9-42a1-ad66-7a9510756fa9] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:31.082194 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-58cc47ab-0a4f-4c22-9188-8638fd850a51 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:31.082638 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-58cc47ab-0a4f-4c22-9188-8638fd850a51 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:31.083414 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-58cc47ab-0a4f-4c22-9188-8638fd850a51 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:31.083816 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-58cc47ab-0a4f-4c22-9188-8638fd850a51 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:31.177653 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.objects.instance [None req-58cc47ab-0a4f-4c22-9188-8638fd850a51 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lazy-loading 'services' on Instance uuid b5fbde14-9db9-42a1-ad66-7a9510756fa9 {{(pid=115876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:34:31.251045 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-58cc47ab-0a4f-4c22-9188-8638fd850a51 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b5fbde14-9db9-42a1-ad66-7a9510756fa9/os-volume_attachments/c62ed946-cc7e-4168-9f02-e62d1a8b1748" status: 202 len: 0 microversion: 2.1 time: 0.179615 Oct 28 12:34:31.251688 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 292/592] 10.222.0.62 () {58 vars in 1415 bytes} [Thu Oct 28 12:34:31 2021] DELETE /compute/v2.1/servers/b5fbde14-9db9-42a1-ad66-7a9510756fa9/os-volume_attachments/c62ed946-cc7e-4168-9f02-e62d1a8b1748 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:34:31.839492 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-d419d9d5-3b2f-42a9-8586-eaf65533adca tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:31.840122 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-d419d9d5-3b2f-42a9-8586-eaf65533adca tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 251e6078-cf22-4b27-b53f-103c7a27e690] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:31.846716 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d419d9d5-3b2f-42a9-8586-eaf65533adca tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:31.847159 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d419d9d5-3b2f-42a9-8586-eaf65533adca tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:31.847929 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d419d9d5-3b2f-42a9-8586-eaf65533adca tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:31.848352 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d419d9d5-3b2f-42a9-8586-eaf65533adca tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:31.976050 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-d419d9d5-3b2f-42a9-8586-eaf65533adca tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:31.984077 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-d419d9d5-3b2f-42a9-8586-eaf65533adca tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/251e6078-cf22-4b27-b53f-103c7a27e690" status: 200 len: 1318 microversion: 2.1 time: 0.149513 Oct 28 12:34:31.984592 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 301/593] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:31 2021] GET /compute/v2.1/servers/251e6078-cf22-4b27-b53f-103c7a27e690 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:32.371350 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-ac4b451e-a10c-4ba5-ba7e-6dd005d0159d tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:32.371979 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-ac4b451e-a10c-4ba5-ba7e-6dd005d0159d tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: b5fbde14-9db9-42a1-ad66-7a9510756fa9] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:32.378882 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ac4b451e-a10c-4ba5-ba7e-6dd005d0159d tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:32.379317 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ac4b451e-a10c-4ba5-ba7e-6dd005d0159d tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:32.380112 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ac4b451e-a10c-4ba5-ba7e-6dd005d0159d tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:32.380527 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ac4b451e-a10c-4ba5-ba7e-6dd005d0159d tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:32.406302 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-ac4b451e-a10c-4ba5-ba7e-6dd005d0159d tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: b5fbde14-9db9-42a1-ad66-7a9510756fa9] Going to try to terminate instance {{(pid=115876) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:34:32.487941 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-ac4b451e-a10c-4ba5-ba7e-6dd005d0159d tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b5fbde14-9db9-42a1-ad66-7a9510756fa9" status: 204 len: 0 microversion: 2.1 time: 0.121224 Oct 28 12:34:32.488659 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 293/594] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Oct 28 12:34:32 2021] DELETE /compute/v2.1/servers/b5fbde14-9db9-42a1-ad66-7a9510756fa9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:34:32.497447 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-13e5a1ed-60f2-42f6-8a0b-52551b89ad45 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:32.498038 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-13e5a1ed-60f2-42f6-8a0b-52551b89ad45 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: b5fbde14-9db9-42a1-ad66-7a9510756fa9] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:32.504052 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-13e5a1ed-60f2-42f6-8a0b-52551b89ad45 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:32.504491 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-13e5a1ed-60f2-42f6-8a0b-52551b89ad45 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:32.505353 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-13e5a1ed-60f2-42f6-8a0b-52551b89ad45 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:32.505810 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-13e5a1ed-60f2-42f6-8a0b-52551b89ad45 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:32.635242 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-13e5a1ed-60f2-42f6-8a0b-52551b89ad45 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a27389ddb44f893f2975cab49ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94643fb6f71b47f79d194ad0849be625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:32.645175 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-13e5a1ed-60f2-42f6-8a0b-52551b89ad45 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "GET /compute/v2.1/servers/b5fbde14-9db9-42a1-ad66-7a9510756fa9" status: 200 len: 1514 microversion: 2.1 time: 0.151332 Oct 28 12:34:32.645899 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 302/595] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:32 2021] GET /compute/v2.1/servers/b5fbde14-9db9-42a1-ad66-7a9510756fa9 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:33.002624 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-eec52502-0e0f-4ea2-b908-da7f94e3c184 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:33.003368 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-eec52502-0e0f-4ea2-b908-da7f94e3c184 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 251e6078-cf22-4b27-b53f-103c7a27e690] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:33.011316 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-eec52502-0e0f-4ea2-b908-da7f94e3c184 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:33.011761 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-eec52502-0e0f-4ea2-b908-da7f94e3c184 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:33.012523 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-eec52502-0e0f-4ea2-b908-da7f94e3c184 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:33.012986 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-eec52502-0e0f-4ea2-b908-da7f94e3c184 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:33.148816 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-eec52502-0e0f-4ea2-b908-da7f94e3c184 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:33.157717 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-eec52502-0e0f-4ea2-b908-da7f94e3c184 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/251e6078-cf22-4b27-b53f-103c7a27e690" status: 200 len: 1318 microversion: 2.1 time: 0.159672 Oct 28 12:34:33.158305 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 294/596] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:32 2021] GET /compute/v2.1/servers/251e6078-cf22-4b27-b53f-103c7a27e690 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:33.664103 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-c89320a0-14c9-4970-b21a-53804165cf02 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:33.664744 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-c89320a0-14c9-4970-b21a-53804165cf02 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: b5fbde14-9db9-42a1-ad66-7a9510756fa9] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:33.671686 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c89320a0-14c9-4970-b21a-53804165cf02 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:33.672140 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c89320a0-14c9-4970-b21a-53804165cf02 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:33.672938 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c89320a0-14c9-4970-b21a-53804165cf02 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:33.673368 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c89320a0-14c9-4970-b21a-53804165cf02 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:33.809305 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-c89320a0-14c9-4970-b21a-53804165cf02 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a27389ddb44f893f2975cab49ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94643fb6f71b47f79d194ad0849be625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:33.818119 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-c89320a0-14c9-4970-b21a-53804165cf02 tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "GET /compute/v2.1/servers/b5fbde14-9db9-42a1-ad66-7a9510756fa9" status: 200 len: 1514 microversion: 2.1 time: 0.157495 Oct 28 12:34:33.818944 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 303/597] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:33 2021] GET /compute/v2.1/servers/b5fbde14-9db9-42a1-ad66-7a9510756fa9 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:34:34.175230 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-b7b6e4b5-853c-43db-8889-d8323f41474d tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:34.175797 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-b7b6e4b5-853c-43db-8889-d8323f41474d tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 251e6078-cf22-4b27-b53f-103c7a27e690] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:34.185150 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b7b6e4b5-853c-43db-8889-d8323f41474d tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:34.185762 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b7b6e4b5-853c-43db-8889-d8323f41474d tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:34.186839 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b7b6e4b5-853c-43db-8889-d8323f41474d tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:34.187333 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b7b6e4b5-853c-43db-8889-d8323f41474d tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:34.314525 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-b7b6e4b5-853c-43db-8889-d8323f41474d tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:34.322680 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-b7b6e4b5-853c-43db-8889-d8323f41474d tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/251e6078-cf22-4b27-b53f-103c7a27e690" status: 200 len: 1318 microversion: 2.1 time: 0.152324 Oct 28 12:34:34.323281 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 295/598] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:34 2021] GET /compute/v2.1/servers/251e6078-cf22-4b27-b53f-103c7a27e690 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:34.838824 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-1c677b5a-5292-4442-a572-66c3b5be668f tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:34.839475 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-1c677b5a-5292-4442-a572-66c3b5be668f tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: b5fbde14-9db9-42a1-ad66-7a9510756fa9] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:34.846264 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1c677b5a-5292-4442-a572-66c3b5be668f tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:34.846714 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1c677b5a-5292-4442-a572-66c3b5be668f tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:34.847452 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1c677b5a-5292-4442-a572-66c3b5be668f tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:34.847884 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1c677b5a-5292-4442-a572-66c3b5be668f tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:34.857502 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-dfdcd9c2-aa1b-4884-8585-4b248049b1a7 req-44abc80d-7146-4870-9e8c-aa9b429e00e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5fbde14-9db9-42a1-ad66-7a9510756fa9", "name": "network-vif-deleted", "tag": "35a1fc7b-548a-4aa4-a3c2-6662f685c0df"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:34:34.859035 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:34:34.859035 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:34:34.866940 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-dfdcd9c2-aa1b-4884-8585-4b248049b1a7 req-44abc80d-7146-4870-9e8c-aa9b429e00e6 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:34.867437 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-dfdcd9c2-aa1b-4884-8585-4b248049b1a7 req-44abc80d-7146-4870-9e8c-aa9b429e00e6 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:34.878942 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-dfdcd9c2-aa1b-4884-8585-4b248049b1a7 req-44abc80d-7146-4870-9e8c-aa9b429e00e6 service nova] Creating event network-vif-deleted:35a1fc7b-548a-4aa4-a3c2-6662f685c0df for instance b5fbde14-9db9-42a1-ad66-7a9510756fa9 on hv-cinder-81514 Oct 28 12:34:34.885163 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-dfdcd9c2-aa1b-4884-8585-4b248049b1a7 req-44abc80d-7146-4870-9e8c-aa9b429e00e6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030962 Oct 28 12:34:34.885872 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 296/599] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:34:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:34:34.916843 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-1c677b5a-5292-4442-a572-66c3b5be668f tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a27389ddb44f893f2975cab49ef7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94643fb6f71b47f79d194ad0849be625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:34.924370 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-1c677b5a-5292-4442-a572-66c3b5be668f tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "GET /compute/v2.1/servers/b5fbde14-9db9-42a1-ad66-7a9510756fa9" status: 200 len: 1472 microversion: 2.1 time: 0.089277 Oct 28 12:34:34.924973 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 304/600] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:34 2021] GET /compute/v2.1/servers/b5fbde14-9db9-42a1-ad66-7a9510756fa9 => generated 1472 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:35.340577 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-7e212a10-eb78-49fc-bbef-25578212b4e5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:35.341925 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-7e212a10-eb78-49fc-bbef-25578212b4e5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 251e6078-cf22-4b27-b53f-103c7a27e690] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:35.349170 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7e212a10-eb78-49fc-bbef-25578212b4e5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:35.349641 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7e212a10-eb78-49fc-bbef-25578212b4e5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:35.350410 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7e212a10-eb78-49fc-bbef-25578212b4e5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:35.350798 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7e212a10-eb78-49fc-bbef-25578212b4e5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:35.392588 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-bbe7b23c-1a8b-499d-a088-b839bf1d6628 req-a6a6662e-e2a9-42ee-9d79-b0c86da18ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "251e6078-cf22-4b27-b53f-103c7a27e690", "name": "network-vif-plugged", "status": "completed", "tag": "bdba618a-d033-41e3-9405-ac2e006dac09"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:34:35.397154 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:34:35.397154 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:34:35.410357 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-bbe7b23c-1a8b-499d-a088-b839bf1d6628 req-a6a6662e-e2a9-42ee-9d79-b0c86da18ec1 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:35.411524 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-bbe7b23c-1a8b-499d-a088-b839bf1d6628 req-a6a6662e-e2a9-42ee-9d79-b0c86da18ec1 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:35.426545 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-bbe7b23c-1a8b-499d-a088-b839bf1d6628 req-a6a6662e-e2a9-42ee-9d79-b0c86da18ec1 service nova] Creating event network-vif-plugged:bdba618a-d033-41e3-9405-ac2e006dac09 for instance 251e6078-cf22-4b27-b53f-103c7a27e690 on hv-cinder-81514 Oct 28 12:34:35.433612 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-bbe7b23c-1a8b-499d-a088-b839bf1d6628 req-a6a6662e-e2a9-42ee-9d79-b0c86da18ec1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046032 Oct 28 12:34:35.434961 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 305/601] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:34:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:34:35.489795 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-7e212a10-eb78-49fc-bbef-25578212b4e5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:35.497620 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-7e212a10-eb78-49fc-bbef-25578212b4e5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/251e6078-cf22-4b27-b53f-103c7a27e690" status: 200 len: 1318 microversion: 2.1 time: 0.161751 Oct 28 12:34:35.498431 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 297/602] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:35 2021] GET /compute/v2.1/servers/251e6078-cf22-4b27-b53f-103c7a27e690 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:35.942163 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-096b293e-1925-4e17-b375-e4e8d5811fbc tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:35.942735 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-096b293e-1925-4e17-b375-e4e8d5811fbc tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] [instance: b5fbde14-9db9-42a1-ad66-7a9510756fa9] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:35.949814 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-096b293e-1925-4e17-b375-e4e8d5811fbc tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:35.950258 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-096b293e-1925-4e17-b375-e4e8d5811fbc tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:35.951217 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-096b293e-1925-4e17-b375-e4e8d5811fbc tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:35.951704 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-096b293e-1925-4e17-b375-e4e8d5811fbc tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:35.964921 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.wsgi [None req-096b293e-1925-4e17-b375-e4e8d5811fbc tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] HTTP exception thrown: Instance b5fbde14-9db9-42a1-ad66-7a9510756fa9 could not be found. Oct 28 12:34:35.965501 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-096b293e-1925-4e17-b375-e4e8d5811fbc tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] Returning 404 to user: Instance b5fbde14-9db9-42a1-ad66-7a9510756fa9 could not be found. {{(pid=115877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:34:35.966314 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-096b293e-1925-4e17-b375-e4e8d5811fbc tempest-VolumesSnapshotTestJSON-1512941529 tempest-VolumesSnapshotTestJSON-1512941529-project] 10.222.0.62 "GET /compute/v2.1/servers/b5fbde14-9db9-42a1-ad66-7a9510756fa9" status: 404 len: 111 microversion: 2.1 time: 0.028407 Oct 28 12:34:35.966841 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 306/603] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:35 2021] GET /compute/v2.1/servers/b5fbde14-9db9-42a1-ad66-7a9510756fa9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:34:36.515806 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-3bf30689-d5f3-48b3-9050-53c8fd1331fc tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:36.516378 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-3bf30689-d5f3-48b3-9050-53c8fd1331fc tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 251e6078-cf22-4b27-b53f-103c7a27e690] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:36.522941 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3bf30689-d5f3-48b3-9050-53c8fd1331fc tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:36.523369 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3bf30689-d5f3-48b3-9050-53c8fd1331fc tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:36.524131 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3bf30689-d5f3-48b3-9050-53c8fd1331fc tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:36.524535 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3bf30689-d5f3-48b3-9050-53c8fd1331fc tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:36.653331 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-3bf30689-d5f3-48b3-9050-53c8fd1331fc tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:36.661657 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-3bf30689-d5f3-48b3-9050-53c8fd1331fc tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/251e6078-cf22-4b27-b53f-103c7a27e690" status: 200 len: 1318 microversion: 2.1 time: 0.149777 Oct 28 12:34:36.662232 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 298/604] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:36 2021] GET /compute/v2.1/servers/251e6078-cf22-4b27-b53f-103c7a27e690 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:37.678947 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-23b1cc48-f3bd-4f24-b6b0-1b7248994ef5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:37.679518 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-23b1cc48-f3bd-4f24-b6b0-1b7248994ef5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 251e6078-cf22-4b27-b53f-103c7a27e690] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:37.686815 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-23b1cc48-f3bd-4f24-b6b0-1b7248994ef5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:37.687251 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-23b1cc48-f3bd-4f24-b6b0-1b7248994ef5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:37.688011 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-23b1cc48-f3bd-4f24-b6b0-1b7248994ef5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:37.688433 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-23b1cc48-f3bd-4f24-b6b0-1b7248994ef5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:37.821544 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-23b1cc48-f3bd-4f24-b6b0-1b7248994ef5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:37.829062 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-23b1cc48-f3bd-4f24-b6b0-1b7248994ef5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/251e6078-cf22-4b27-b53f-103c7a27e690" status: 200 len: 1508 microversion: 2.1 time: 0.153984 Oct 28 12:34:37.829617 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 307/605] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:37 2021] GET /compute/v2.1/servers/251e6078-cf22-4b27-b53f-103c7a27e690 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:37.852243 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-89b16c16-6452-4eab-9419-a2cc349d58b5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11e8c430-23d7-44a1-9cdb-089b366a34a6"}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:34:37.854046 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-89b16c16-6452-4eab-9419-a2cc349d58b5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 251e6078-cf22-4b27-b53f-103c7a27e690] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:37.860708 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-89b16c16-6452-4eab-9419-a2cc349d58b5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:37.861168 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-89b16c16-6452-4eab-9419-a2cc349d58b5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:37.861926 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-89b16c16-6452-4eab-9419-a2cc349d58b5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:37.862345 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-89b16c16-6452-4eab-9419-a2cc349d58b5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:37.950354 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.wsgi [None req-89b16c16-6452-4eab-9419-a2cc349d58b5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] HTTP exception thrown: Invalid volume: volume 11e8c430-23d7-44a1-9cdb-089b366a34a6 is already attached to instances: c8647488-6b19-46a6-a95e-7280a2f63c58 Oct 28 12:34:37.950944 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-89b16c16-6452-4eab-9419-a2cc349d58b5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Returning 400 to user: Invalid volume: volume 11e8c430-23d7-44a1-9cdb-089b366a34a6 is already attached to instances: c8647488-6b19-46a6-a95e-7280a2f63c58 {{(pid=115876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:34:37.951767 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-89b16c16-6452-4eab-9419-a2cc349d58b5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "POST /compute/v2.1/servers/251e6078-cf22-4b27-b53f-103c7a27e690/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103696 Oct 28 12:34:37.952316 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 299/606] 10.222.0.62 () {60 vars in 1322 bytes} [Thu Oct 28 12:34:37 2021] POST /compute/v2.1/servers/251e6078-cf22-4b27-b53f-103c7a27e690/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 12:34:38.011012 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-6de19d10-e37f-4c57-b40d-eb3770b87188 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:38.011562 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-6de19d10-e37f-4c57-b40d-eb3770b87188 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: c8647488-6b19-46a6-a95e-7280a2f63c58] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:38.017635 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6de19d10-e37f-4c57-b40d-eb3770b87188 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:38.018077 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6de19d10-e37f-4c57-b40d-eb3770b87188 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:38.018834 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6de19d10-e37f-4c57-b40d-eb3770b87188 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:38.019263 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6de19d10-e37f-4c57-b40d-eb3770b87188 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:38.101703 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.objects.instance [None req-6de19d10-e37f-4c57-b40d-eb3770b87188 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lazy-loading 'services' on Instance uuid c8647488-6b19-46a6-a95e-7280a2f63c58 {{(pid=115877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:34:38.173778 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-6de19d10-e37f-4c57-b40d-eb3770b87188 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58/os-volume_attachments/11e8c430-23d7-44a1-9cdb-089b366a34a6" status: 202 len: 0 microversion: 2.1 time: 0.166354 Oct 28 12:34:38.174371 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 308/607] 10.222.0.62 () {58 vars in 1415 bytes} [Thu Oct 28 12:34:38 2021] DELETE /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58/os-volume_attachments/11e8c430-23d7-44a1-9cdb-089b366a34a6 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:34:38.183143 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-01cbc4a5-628f-44c6-890b-4f5c5fbb12fc tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:38.184167 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-01cbc4a5-628f-44c6-890b-4f5c5fbb12fc tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: c8647488-6b19-46a6-a95e-7280a2f63c58] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:38.191412 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-01cbc4a5-628f-44c6-890b-4f5c5fbb12fc tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:38.191832 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-01cbc4a5-628f-44c6-890b-4f5c5fbb12fc tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:38.192832 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-01cbc4a5-628f-44c6-890b-4f5c5fbb12fc tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:38.193265 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-01cbc4a5-628f-44c6-890b-4f5c5fbb12fc tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:38.222559 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-01cbc4a5-628f-44c6-890b-4f5c5fbb12fc tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043625 Oct 28 12:34:38.223114 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 300/608] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Oct 28 12:34:38 2021] GET /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:34:39.236494 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-394a2326-b8c7-4276-a085-9a063dcad4cf tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:39.237554 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-394a2326-b8c7-4276-a085-9a063dcad4cf tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: c8647488-6b19-46a6-a95e-7280a2f63c58] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:39.244474 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-394a2326-b8c7-4276-a085-9a063dcad4cf tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:39.244940 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-394a2326-b8c7-4276-a085-9a063dcad4cf tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:39.245706 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-394a2326-b8c7-4276-a085-9a063dcad4cf tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:39.246245 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-394a2326-b8c7-4276-a085-9a063dcad4cf tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:39.281674 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-394a2326-b8c7-4276-a085-9a063dcad4cf tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049894 Oct 28 12:34:39.282241 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 309/609] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Oct 28 12:34:39 2021] GET /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:34:40.294111 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-b00e38e2-0ed6-4683-bc41-5a27a39eeab0 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:40.295479 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-b00e38e2-0ed6-4683-bc41-5a27a39eeab0 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: c8647488-6b19-46a6-a95e-7280a2f63c58] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:40.305195 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b00e38e2-0ed6-4683-bc41-5a27a39eeab0 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:40.306364 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b00e38e2-0ed6-4683-bc41-5a27a39eeab0 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:40.307507 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b00e38e2-0ed6-4683-bc41-5a27a39eeab0 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:40.307963 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b00e38e2-0ed6-4683-bc41-5a27a39eeab0 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:40.342680 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-b00e38e2-0ed6-4683-bc41-5a27a39eeab0 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052627 Oct 28 12:34:40.343237 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 301/610] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Oct 28 12:34:40 2021] GET /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:34:41.354615 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-7b2f2408-94a9-4e16-bcbb-03db69170506 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:41.356350 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-7b2f2408-94a9-4e16-bcbb-03db69170506 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: c8647488-6b19-46a6-a95e-7280a2f63c58] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:41.364375 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7b2f2408-94a9-4e16-bcbb-03db69170506 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:41.364850 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7b2f2408-94a9-4e16-bcbb-03db69170506 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:41.365652 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7b2f2408-94a9-4e16-bcbb-03db69170506 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:41.366265 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7b2f2408-94a9-4e16-bcbb-03db69170506 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:41.403034 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-7b2f2408-94a9-4e16-bcbb-03db69170506 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052094 Oct 28 12:34:41.403611 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 310/611] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Oct 28 12:34:41 2021] GET /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:34:41.507881 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-7f684f3e-344a-431f-a6ae-9899e8d82a07 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1778062381", "imageRef": "575f28c8-0af2-4973-b3d9-a249e2400c6e", "flavorRef": "452", "networks": [{"uuid": "e80a2853-2c5f-4e30-b57e-4bb32d36cb7b"}]}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:34:41.568886 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.network.neutron [None req-7f684f3e-344a-431f-a6ae-9899e8d82a07 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] validate_networks() for [('e80a2853-2c5f-4e30-b57e-4bb32d36cb7b', None, None, None, None, None)] {{(pid=115876) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:34:41.998870 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-7f684f3e-344a-431f-a6ae-9899e8d82a07 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Flavor limits 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:34:41.999441 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-7f684f3e-344a-431f-a6ae-9899e8d82a07 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Image limits 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:34:41.999914 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-7f684f3e-344a-431f-a6ae-9899e8d82a07 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Flavor pref 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:34:42.000439 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-7f684f3e-344a-431f-a6ae-9899e8d82a07 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Image pref 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:34:42.000998 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-7f684f3e-344a-431f-a6ae-9899e8d82a07 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:34:42.010346 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7f684f3e-344a-431f-a6ae-9899e8d82a07 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:42.010593 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7f684f3e-344a-431f-a6ae-9899e8d82a07 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:42.011421 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7f684f3e-344a-431f-a6ae-9899e8d82a07 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:42.011931 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7f684f3e-344a-431f-a6ae-9899e8d82a07 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:42.029100 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-7f684f3e-344a-431f-a6ae-9899e8d82a07 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Getting quotas for project 36003ac4ee5e4de5b4ef1ed104c55b6c. Resources: {'cores', 'instances', 'ram'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:34:42.033041 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-7f684f3e-344a-431f-a6ae-9899e8d82a07 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Getting quotas for user ec86adff43114c36a65f2bb590e4f6e8 and project 36003ac4ee5e4de5b4ef1ed104c55b6c. Resources: {'cores', 'instances', 'ram'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:34:42.052310 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-7f684f3e-344a-431f-a6ae-9899e8d82a07 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Going to run 1 instances... {{(pid=115876) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:34:42.056763 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-7f684f3e-344a-431f-a6ae-9899e8d82a07 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 9d962dac-e3a8-4f73-bc9e-bc11692b0250] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='575f28c8-0af2-4973-b3d9-a249e2400c6e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:34:42.102163 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-7f684f3e-344a-431f-a6ae-9899e8d82a07 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.597949 Oct 28 12:34:42.102785 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 302/612] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Oct 28 12:34:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 12:34:42.115973 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-5832a060-9cf7-4458-a9c8-5e5885d98221 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:42.116657 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-5832a060-9cf7-4458-a9c8-5e5885d98221 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 9d962dac-e3a8-4f73-bc9e-bc11692b0250] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:42.174335 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-5832a060-9cf7-4458-a9c8-5e5885d98221 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:42.181564 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-5832a060-9cf7-4458-a9c8-5e5885d98221 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250" status: 200 len: 1218 microversion: 2.1 time: 0.070506 Oct 28 12:34:42.182145 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 311/613] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:42 2021] GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250 => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:43.199412 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-b39218e7-7761-41f5-86a5-f08fd93fa13c tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:43.200010 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-b39218e7-7761-41f5-86a5-f08fd93fa13c tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 9d962dac-e3a8-4f73-bc9e-bc11692b0250] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:43.207186 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b39218e7-7761-41f5-86a5-f08fd93fa13c tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:43.207641 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b39218e7-7761-41f5-86a5-f08fd93fa13c tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:43.208554 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b39218e7-7761-41f5-86a5-f08fd93fa13c tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:43.208964 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b39218e7-7761-41f5-86a5-f08fd93fa13c tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:43.274379 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-b39218e7-7761-41f5-86a5-f08fd93fa13c tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:43.282221 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-b39218e7-7761-41f5-86a5-f08fd93fa13c tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250" status: 200 len: 1270 microversion: 2.1 time: 0.087002 Oct 28 12:34:43.282892 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 303/614] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:43 2021] GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250 => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:44.302926 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-00f684fc-2637-4332-8dd6-703b8c5128f5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:44.304151 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-00f684fc-2637-4332-8dd6-703b8c5128f5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 9d962dac-e3a8-4f73-bc9e-bc11692b0250] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:44.311555 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-00f684fc-2637-4332-8dd6-703b8c5128f5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:44.312374 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-00f684fc-2637-4332-8dd6-703b8c5128f5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:44.313464 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-00f684fc-2637-4332-8dd6-703b8c5128f5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:44.313937 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-00f684fc-2637-4332-8dd6-703b8c5128f5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:44.482543 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-00f684fc-2637-4332-8dd6-703b8c5128f5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:44.490512 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-00f684fc-2637-4332-8dd6-703b8c5128f5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250" status: 200 len: 1318 microversion: 2.1 time: 0.191903 Oct 28 12:34:44.491092 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 312/615] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:44 2021] GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:44.954101 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-b7d0706a-01ca-40c8-a330-435a63d575af req-c6f87c4e-dd85-4127-bd20-8547b8cd58c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d962dac-e3a8-4f73-bc9e-bc11692b0250", "tag": "666fa29b-3f69-4f77-ae13-5a61867d742b"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:34:44.956256 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:34:44.956256 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:34:44.964362 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-b7d0706a-01ca-40c8-a330-435a63d575af req-c6f87c4e-dd85-4127-bd20-8547b8cd58c6 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:44.964848 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-b7d0706a-01ca-40c8-a330-435a63d575af req-c6f87c4e-dd85-4127-bd20-8547b8cd58c6 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:44.976932 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-b7d0706a-01ca-40c8-a330-435a63d575af req-c6f87c4e-dd85-4127-bd20-8547b8cd58c6 service nova] Creating event network-changed:666fa29b-3f69-4f77-ae13-5a61867d742b for instance 9d962dac-e3a8-4f73-bc9e-bc11692b0250 on hv-cinder-81514 Oct 28 12:34:44.982971 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-b7d0706a-01ca-40c8-a330-435a63d575af req-c6f87c4e-dd85-4127-bd20-8547b8cd58c6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032452 Oct 28 12:34:44.983598 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 304/616] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:34:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:34:45.508046 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-f045efa0-8804-4ae0-8069-a421775a0b4a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:45.508702 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-f045efa0-8804-4ae0-8069-a421775a0b4a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 9d962dac-e3a8-4f73-bc9e-bc11692b0250] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:45.515677 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f045efa0-8804-4ae0-8069-a421775a0b4a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:45.516120 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f045efa0-8804-4ae0-8069-a421775a0b4a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:45.516923 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f045efa0-8804-4ae0-8069-a421775a0b4a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:45.517606 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f045efa0-8804-4ae0-8069-a421775a0b4a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:45.658217 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-f045efa0-8804-4ae0-8069-a421775a0b4a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:45.667372 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-f045efa0-8804-4ae0-8069-a421775a0b4a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250" status: 200 len: 1318 microversion: 2.1 time: 0.163226 Oct 28 12:34:45.668589 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 313/617] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:45 2021] GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:46.686641 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-c944a986-c81c-4723-85a0-44dfca6e2056 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:46.687359 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-c944a986-c81c-4723-85a0-44dfca6e2056 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 9d962dac-e3a8-4f73-bc9e-bc11692b0250] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:46.693911 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c944a986-c81c-4723-85a0-44dfca6e2056 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:46.694354 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c944a986-c81c-4723-85a0-44dfca6e2056 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:46.695115 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c944a986-c81c-4723-85a0-44dfca6e2056 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:46.695537 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-c944a986-c81c-4723-85a0-44dfca6e2056 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:46.827834 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-c944a986-c81c-4723-85a0-44dfca6e2056 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:46.836983 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-c944a986-c81c-4723-85a0-44dfca6e2056 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250" status: 200 len: 1318 microversion: 2.1 time: 0.155308 Oct 28 12:34:46.837584 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 305/618] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:46 2021] GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:47.854455 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-b3e3ce3a-cb3e-4cd9-bdd4-e7021213cc5a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:47.855146 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-b3e3ce3a-cb3e-4cd9-bdd4-e7021213cc5a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 9d962dac-e3a8-4f73-bc9e-bc11692b0250] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:47.861983 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b3e3ce3a-cb3e-4cd9-bdd4-e7021213cc5a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:47.862429 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b3e3ce3a-cb3e-4cd9-bdd4-e7021213cc5a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:47.863191 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b3e3ce3a-cb3e-4cd9-bdd4-e7021213cc5a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:47.863615 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b3e3ce3a-cb3e-4cd9-bdd4-e7021213cc5a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:47.994167 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-b3e3ce3a-cb3e-4cd9-bdd4-e7021213cc5a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:48.003362 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-b3e3ce3a-cb3e-4cd9-bdd4-e7021213cc5a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250" status: 200 len: 1318 microversion: 2.1 time: 0.152592 Oct 28 12:34:48.003975 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 314/619] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:47 2021] GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:49.019360 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-51080655-f212-452a-9cfc-88a0b045896a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:49.020171 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-51080655-f212-452a-9cfc-88a0b045896a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 9d962dac-e3a8-4f73-bc9e-bc11692b0250] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:49.020691 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-3477abda-0f96-465a-b576-59d275751e88 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:49.021243 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-3477abda-0f96-465a-b576-59d275751e88 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:49.026837 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-51080655-f212-452a-9cfc-88a0b045896a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:49.027299 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-51080655-f212-452a-9cfc-88a0b045896a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:49.028126 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-51080655-f212-452a-9cfc-88a0b045896a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:49.028333 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3477abda-0f96-465a-b576-59d275751e88 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:49.028550 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-51080655-f212-452a-9cfc-88a0b045896a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:49.028743 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3477abda-0f96-465a-b576-59d275751e88 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:49.029465 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3477abda-0f96-465a-b576-59d275751e88 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:49.029890 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3477abda-0f96-465a-b576-59d275751e88 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:49.066055 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-3477abda-0f96-465a-b576-59d275751e88 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/os-volume_attachments/5299c6e5-4f51-4a0f-9b3b-eb71927bd18b" status: 200 len: 194 microversion: 2.20 time: 0.049777 Oct 28 12:34:49.066681 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 306/620] 10.222.0.62 () {60 vars in 1453 bytes} [Thu Oct 28 12:34:49 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/os-volume_attachments/5299c6e5-4f51-4a0f-9b3b-eb71927bd18b => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:34:49.137509 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-628e9625-f4bc-4c32-88fe-e0744b486f74 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:49.138140 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-628e9625-f4bc-4c32-88fe-e0744b486f74 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:49.144734 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-628e9625-f4bc-4c32-88fe-e0744b486f74 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:49.145173 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-628e9625-f4bc-4c32-88fe-e0744b486f74 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:49.145942 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-628e9625-f4bc-4c32-88fe-e0744b486f74 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:49.146360 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-628e9625-f4bc-4c32-88fe-e0744b486f74 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:49.171851 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-51080655-f212-452a-9cfc-88a0b045896a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:49.180969 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-51080655-f212-452a-9cfc-88a0b045896a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250" status: 200 len: 1318 microversion: 2.1 time: 0.164859 Oct 28 12:34:49.181554 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 315/621] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:49 2021] GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:34:49.242149 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.objects.instance [None req-628e9625-f4bc-4c32-88fe-e0744b486f74 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lazy-loading 'services' on Instance uuid f6a3a830-8175-434e-8c23-336ccacf7ef8 {{(pid=115876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:34:49.322345 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-628e9625-f4bc-4c32-88fe-e0744b486f74 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/os-volume_attachments/5299c6e5-4f51-4a0f-9b3b-eb71927bd18b" status: 202 len: 0 microversion: 2.20 time: 0.189591 Oct 28 12:34:49.322978 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 307/622] 10.222.0.62 () {60 vars in 1456 bytes} [Thu Oct 28 12:34:49 2021] DELETE /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/os-volume_attachments/5299c6e5-4f51-4a0f-9b3b-eb71927bd18b => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 28 12:34:49.331631 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-f3c4d19b-5a93-42b8-9ec4-e44554d89cf1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:49.332649 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-f3c4d19b-5a93-42b8-9ec4-e44554d89cf1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:49.340810 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f3c4d19b-5a93-42b8-9ec4-e44554d89cf1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:49.341569 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f3c4d19b-5a93-42b8-9ec4-e44554d89cf1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:49.343049 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f3c4d19b-5a93-42b8-9ec4-e44554d89cf1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:49.343816 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f3c4d19b-5a93-42b8-9ec4-e44554d89cf1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:49.382710 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-f3c4d19b-5a93-42b8-9ec4-e44554d89cf1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054872 Oct 28 12:34:49.383333 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 316/623] 10.222.0.62 () {60 vars in 1342 bytes} [Thu Oct 28 12:34:49 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:34:50.199478 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-0ee31288-79b8-4cc7-8586-efa0b77c32d6 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:50.200480 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-0ee31288-79b8-4cc7-8586-efa0b77c32d6 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 9d962dac-e3a8-4f73-bc9e-bc11692b0250] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:50.207044 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-0ee31288-79b8-4cc7-8586-efa0b77c32d6 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:50.207642 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-0ee31288-79b8-4cc7-8586-efa0b77c32d6 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:50.208394 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-0ee31288-79b8-4cc7-8586-efa0b77c32d6 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:50.208840 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-0ee31288-79b8-4cc7-8586-efa0b77c32d6 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:50.350305 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-0ee31288-79b8-4cc7-8586-efa0b77c32d6 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:50.359142 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-0ee31288-79b8-4cc7-8586-efa0b77c32d6 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250" status: 200 len: 1318 microversion: 2.1 time: 0.164724 Oct 28 12:34:50.359708 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 308/624] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:50 2021] GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:50.394541 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-69b22c1f-482f-4589-8458-451711349ee7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:50.395436 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-69b22c1f-482f-4589-8458-451711349ee7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:50.402182 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-69b22c1f-482f-4589-8458-451711349ee7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:50.402617 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-69b22c1f-482f-4589-8458-451711349ee7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:50.403470 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-69b22c1f-482f-4589-8458-451711349ee7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:50.403905 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-69b22c1f-482f-4589-8458-451711349ee7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:50.432480 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-69b22c1f-482f-4589-8458-451711349ee7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041746 Oct 28 12:34:50.433042 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 317/625] 10.222.0.62 () {60 vars in 1342 bytes} [Thu Oct 28 12:34:50 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:34:50.493909 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-008478d0-01e7-4c8c-a09d-825700b5548e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:50.494712 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-008478d0-01e7-4c8c-a09d-825700b5548e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:50.502515 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-008478d0-01e7-4c8c-a09d-825700b5548e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:50.502956 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-008478d0-01e7-4c8c-a09d-825700b5548e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:50.503715 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-008478d0-01e7-4c8c-a09d-825700b5548e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:50.504142 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-008478d0-01e7-4c8c-a09d-825700b5548e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:50.528984 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-008478d0-01e7-4c8c-a09d-825700b5548e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Going to try to terminate instance {{(pid=115876) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:34:50.607846 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-008478d0-01e7-4c8c-a09d-825700b5548e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 204 len: 0 microversion: 2.20 time: 0.119116 Oct 28 12:34:50.608517 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 309/626] 10.222.0.62 () {60 vars in 1279 bytes} [Thu Oct 28 12:34:50 2021] DELETE /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 12:34:50.616795 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-f7414d81-bf87-4940-bbf7-1058d2325ff0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:50.617405 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-f7414d81-bf87-4940-bbf7-1058d2325ff0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:50.623385 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f7414d81-bf87-4940-bbf7-1058d2325ff0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:50.623846 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f7414d81-bf87-4940-bbf7-1058d2325ff0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:50.624587 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f7414d81-bf87-4940-bbf7-1058d2325ff0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:50.625060 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f7414d81-bf87-4940-bbf7-1058d2325ff0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:50.764398 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-f7414d81-bf87-4940-bbf7-1058d2325ff0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:50.772757 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-f7414d81-bf87-4940-bbf7-1058d2325ff0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:50.774237 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-f7414d81-bf87-4940-bbf7-1058d2325ff0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:50.775397 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-f7414d81-bf87-4940-bbf7-1058d2325ff0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1724 microversion: 2.20 time: 0.162493 Oct 28 12:34:50.775952 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 318/627] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:34:50 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:34:51.376058 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-dc0a1891-d789-45c3-a438-c4c62a005421 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:51.376866 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-dc0a1891-d789-45c3-a438-c4c62a005421 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 9d962dac-e3a8-4f73-bc9e-bc11692b0250] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:51.383711 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-dc0a1891-d789-45c3-a438-c4c62a005421 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:51.384070 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-dc0a1891-d789-45c3-a438-c4c62a005421 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:51.384867 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-dc0a1891-d789-45c3-a438-c4c62a005421 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:51.385283 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-dc0a1891-d789-45c3-a438-c4c62a005421 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:51.515624 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-dc0a1891-d789-45c3-a438-c4c62a005421 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:51.522996 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-dc0a1891-d789-45c3-a438-c4c62a005421 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250" status: 200 len: 1318 microversion: 2.1 time: 0.151017 Oct 28 12:34:51.523552 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 310/628] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:51 2021] GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:51.795013 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-63a1478f-0426-407f-a10a-01f93bee9c22 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:51.795655 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-63a1478f-0426-407f-a10a-01f93bee9c22 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:51.802325 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-63a1478f-0426-407f-a10a-01f93bee9c22 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:51.802759 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-63a1478f-0426-407f-a10a-01f93bee9c22 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:51.803497 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-63a1478f-0426-407f-a10a-01f93bee9c22 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:51.803916 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-63a1478f-0426-407f-a10a-01f93bee9c22 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:51.938094 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-63a1478f-0426-407f-a10a-01f93bee9c22 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:51.949257 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-63a1478f-0426-407f-a10a-01f93bee9c22 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:51.951629 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-63a1478f-0426-407f-a10a-01f93bee9c22 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:51.953495 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-63a1478f-0426-407f-a10a-01f93bee9c22 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1724 microversion: 2.20 time: 0.161992 Oct 28 12:34:51.954409 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 319/629] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:34:51 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:34:52.540507 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-903cfc49-164b-4b99-9caa-1d25b12fbb89 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:52.541177 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-903cfc49-164b-4b99-9caa-1d25b12fbb89 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 9d962dac-e3a8-4f73-bc9e-bc11692b0250] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:52.550306 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-903cfc49-164b-4b99-9caa-1d25b12fbb89 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:52.551138 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-903cfc49-164b-4b99-9caa-1d25b12fbb89 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:52.551985 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-903cfc49-164b-4b99-9caa-1d25b12fbb89 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:52.552403 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-903cfc49-164b-4b99-9caa-1d25b12fbb89 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:52.684169 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-903cfc49-164b-4b99-9caa-1d25b12fbb89 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:52.691491 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-903cfc49-164b-4b99-9caa-1d25b12fbb89 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250" status: 200 len: 1318 microversion: 2.1 time: 0.155532 Oct 28 12:34:52.692274 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 311/630] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:52 2021] GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:52.975209 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-99651520-814e-4373-af1d-a249d789db04 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:52.975827 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-99651520-814e-4373-af1d-a249d789db04 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:52.982732 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-99651520-814e-4373-af1d-a249d789db04 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:52.983239 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-99651520-814e-4373-af1d-a249d789db04 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:52.984032 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-99651520-814e-4373-af1d-a249d789db04 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:52.984459 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-99651520-814e-4373-af1d-a249d789db04 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:53.113720 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-99651520-814e-4373-af1d-a249d789db04 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:53.122233 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-99651520-814e-4373-af1d-a249d789db04 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:53.123733 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-99651520-814e-4373-af1d-a249d789db04 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:53.124914 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-99651520-814e-4373-af1d-a249d789db04 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1724 microversion: 2.20 time: 0.153468 Oct 28 12:34:53.125648 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 320/631] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:34:52 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:34:53.341219 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-fb16e8e1-b2de-48f1-a396-a37f03eafdee req-0d7ed2d1-e8c0-456e-801b-e60f629b6c8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d962dac-e3a8-4f73-bc9e-bc11692b0250", "name": "network-vif-plugged", "status": "completed", "tag": "666fa29b-3f69-4f77-ae13-5a61867d742b"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:34:53.343468 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:34:53.343468 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:34:53.351689 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-fb16e8e1-b2de-48f1-a396-a37f03eafdee req-0d7ed2d1-e8c0-456e-801b-e60f629b6c8f service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:53.352284 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-fb16e8e1-b2de-48f1-a396-a37f03eafdee req-0d7ed2d1-e8c0-456e-801b-e60f629b6c8f service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:53.367146 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-fb16e8e1-b2de-48f1-a396-a37f03eafdee req-0d7ed2d1-e8c0-456e-801b-e60f629b6c8f service nova] Creating event network-vif-plugged:666fa29b-3f69-4f77-ae13-5a61867d742b for instance 9d962dac-e3a8-4f73-bc9e-bc11692b0250 on hv-cinder-81514 Oct 28 12:34:53.375965 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-fb16e8e1-b2de-48f1-a396-a37f03eafdee req-0d7ed2d1-e8c0-456e-801b-e60f629b6c8f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037937 Oct 28 12:34:53.376817 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 312/632] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:34:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:34:53.557049 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-44cd70ce-3a6b-4efc-82d0-7aa61f187d1f req-3c95615d-a5c5-475d-9fd8-2bc2f3a78f9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6a3a830-8175-434e-8c23-336ccacf7ef8", "name": "network-vif-deleted", "tag": "fd7216a9-4fe8-4770-a641-9f1115f86217"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:34:53.558606 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:34:53.558606 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:34:53.569899 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-44cd70ce-3a6b-4efc-82d0-7aa61f187d1f req-3c95615d-a5c5-475d-9fd8-2bc2f3a78f9d service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:53.570335 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-44cd70ce-3a6b-4efc-82d0-7aa61f187d1f req-3c95615d-a5c5-475d-9fd8-2bc2f3a78f9d service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:53.583719 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-44cd70ce-3a6b-4efc-82d0-7aa61f187d1f req-3c95615d-a5c5-475d-9fd8-2bc2f3a78f9d service nova] Creating event network-vif-deleted:fd7216a9-4fe8-4770-a641-9f1115f86217 for instance f6a3a830-8175-434e-8c23-336ccacf7ef8 on hv-cinder-81514 Oct 28 12:34:53.590663 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-44cd70ce-3a6b-4efc-82d0-7aa61f187d1f req-3c95615d-a5c5-475d-9fd8-2bc2f3a78f9d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037440 Oct 28 12:34:53.592821 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 321/633] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:34:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:34:53.710801 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-7352abc9-b9d8-4ee7-b04f-5c5ba3bc0f07 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:53.712151 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-7352abc9-b9d8-4ee7-b04f-5c5ba3bc0f07 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 9d962dac-e3a8-4f73-bc9e-bc11692b0250] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:53.723119 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7352abc9-b9d8-4ee7-b04f-5c5ba3bc0f07 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:53.723617 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7352abc9-b9d8-4ee7-b04f-5c5ba3bc0f07 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:53.724417 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7352abc9-b9d8-4ee7-b04f-5c5ba3bc0f07 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:53.724874 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7352abc9-b9d8-4ee7-b04f-5c5ba3bc0f07 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:53.876198 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-7352abc9-b9d8-4ee7-b04f-5c5ba3bc0f07 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:53.883662 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-7352abc9-b9d8-4ee7-b04f-5c5ba3bc0f07 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250" status: 200 len: 1318 microversion: 2.1 time: 0.177401 Oct 28 12:34:53.884287 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 313/634] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:53 2021] GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:54.145509 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-558cc7b1-e238-4cb8-b8d0-48e65f82630b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:54.146216 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-558cc7b1-e238-4cb8-b8d0-48e65f82630b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:54.153202 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-558cc7b1-e238-4cb8-b8d0-48e65f82630b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:54.153895 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-558cc7b1-e238-4cb8-b8d0-48e65f82630b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:54.154917 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-558cc7b1-e238-4cb8-b8d0-48e65f82630b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:54.155496 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-558cc7b1-e238-4cb8-b8d0-48e65f82630b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:54.189270 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-558cc7b1-e238-4cb8-b8d0-48e65f82630b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:54.189706 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-558cc7b1-e238-4cb8-b8d0-48e65f82630b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:54.190157 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.objects.instance [None req-558cc7b1-e238-4cb8-b8d0-48e65f82630b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lazy-loading 'fault' on Instance uuid f6a3a830-8175-434e-8c23-336ccacf7ef8 {{(pid=115877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:34:54.234521 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-558cc7b1-e238-4cb8-b8d0-48e65f82630b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:54.243087 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-558cc7b1-e238-4cb8-b8d0-48e65f82630b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:54.245003 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-558cc7b1-e238-4cb8-b8d0-48e65f82630b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:54.246193 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-558cc7b1-e238-4cb8-b8d0-48e65f82630b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 200 len: 1371 microversion: 2.20 time: 0.104909 Oct 28 12:34:54.246719 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 322/635] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:34:54 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:34:54.901866 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-9177c407-15b3-4605-bca3-d0b452188cb5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:54.902524 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-9177c407-15b3-4605-bca3-d0b452188cb5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 9d962dac-e3a8-4f73-bc9e-bc11692b0250] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:54.912968 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9177c407-15b3-4605-bca3-d0b452188cb5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:54.913566 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9177c407-15b3-4605-bca3-d0b452188cb5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:54.914433 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9177c407-15b3-4605-bca3-d0b452188cb5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:54.914928 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9177c407-15b3-4605-bca3-d0b452188cb5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:55.059629 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-9177c407-15b3-4605-bca3-d0b452188cb5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:55.070173 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-9177c407-15b3-4605-bca3-d0b452188cb5 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250" status: 200 len: 1318 microversion: 2.1 time: 0.172058 Oct 28 12:34:55.071180 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 314/636] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:54 2021] GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:55.267976 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-6390edc1-d7be-4560-8ff0-fb6162d74a7d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:55.268566 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-6390edc1-d7be-4560-8ff0-fb6162d74a7d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:55.275683 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6390edc1-d7be-4560-8ff0-fb6162d74a7d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:55.276112 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6390edc1-d7be-4560-8ff0-fb6162d74a7d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:55.276932 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6390edc1-d7be-4560-8ff0-fb6162d74a7d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:55.277374 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6390edc1-d7be-4560-8ff0-fb6162d74a7d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:55.292916 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.wsgi [None req-6390edc1-d7be-4560-8ff0-fb6162d74a7d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] HTTP exception thrown: Instance f6a3a830-8175-434e-8c23-336ccacf7ef8 could not be found. Oct 28 12:34:55.293525 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-6390edc1-d7be-4560-8ff0-fb6162d74a7d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Returning 404 to user: Instance f6a3a830-8175-434e-8c23-336ccacf7ef8 could not be found. {{(pid=115877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:34:55.294389 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-6390edc1-d7be-4560-8ff0-fb6162d74a7d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 404 len: 111 microversion: 2.20 time: 0.030396 Oct 28 12:34:55.295289 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 323/637] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:34:55 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 12:34:55.304194 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-2f416ea9-66b2-4f3f-9f90-ded7ad90efcb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '.version_select at 0x7f4a794058b0>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:55.329216 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-2f416ea9-66b2-4f3f-9f90-ded7ad90efcb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1051813444" status: 204 len: 0 microversion: 2.20 time: 0.028702 Oct 28 12:34:55.330078 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 315/638] 10.222.0.62 () {60 vars in 1261 bytes} [Thu Oct 28 12:34:55 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1051813444 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 12:34:56.088939 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-4b0def9c-5143-4c83-acbc-47aeb4d30332 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:56.090040 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-4b0def9c-5143-4c83-acbc-47aeb4d30332 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 9d962dac-e3a8-4f73-bc9e-bc11692b0250] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:56.096276 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4b0def9c-5143-4c83-acbc-47aeb4d30332 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:56.097117 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4b0def9c-5143-4c83-acbc-47aeb4d30332 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:56.097991 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4b0def9c-5143-4c83-acbc-47aeb4d30332 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:56.098795 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4b0def9c-5143-4c83-acbc-47aeb4d30332 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:56.311638 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-1541c327-0f40-4a27-ac9e-5d4499181173 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'create', calling method: .version_select at 0x7f4a795ae160>, body: {"keypair": {"name": "tempest-keypair-216996260"}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:34:56.318588 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-4b0def9c-5143-4c83-acbc-47aeb4d30332 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:56.332326 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-4b0def9c-5143-4c83-acbc-47aeb4d30332 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250" status: 200 len: 1507 microversion: 2.1 time: 0.247611 Oct 28 12:34:56.332569 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-1541c327-0f40-4a27-ac9e-5d4499181173 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Getting quotas for project 0ae5fd59e495402c829af6819f873149. Resources: {'key_pairs'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:34:56.333363 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 324/639] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:34:56 2021] GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250 => generated 1507 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:34:56.336910 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-1541c327-0f40-4a27-ac9e-5d4499181173 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Getting quotas for user 4d38f499bdf74241a876e06ca3e05503 and project 0ae5fd59e495402c829af6819f873149. Resources: {'key_pairs'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:34:56.534370 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-1541c327-0f40-4a27-ac9e-5d4499181173 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Getting quotas for project 0ae5fd59e495402c829af6819f873149. Resources: {'key_pairs'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:34:56.539580 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-1541c327-0f40-4a27-ac9e-5d4499181173 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Getting quotas for user 4d38f499bdf74241a876e06ca3e05503 and project 0ae5fd59e495402c829af6819f873149. Resources: {'key_pairs'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:34:56.553726 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-1541c327-0f40-4a27-ac9e-5d4499181173 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.245827 Oct 28 12:34:56.554677 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 316/640] 10.222.0.62 () {62 vars in 1198 bytes} [Thu Oct 28 12:34:56 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 247 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Oct 28 12:34:57.673378 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-6a053afc-9998-4e63-8894-a9e630d7d982 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01db5a36-6b2f-4703-bb2c-c2b5e12183d1"}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:34:57.674462 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-6a053afc-9998-4e63-8894-a9e630d7d982 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 9d962dac-e3a8-4f73-bc9e-bc11692b0250] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:57.682376 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6a053afc-9998-4e63-8894-a9e630d7d982 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:57.682824 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6a053afc-9998-4e63-8894-a9e630d7d982 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:57.683598 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6a053afc-9998-4e63-8894-a9e630d7d982 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:57.684025 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6a053afc-9998-4e63-8894-a9e630d7d982 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:57.993844 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-6a053afc-9998-4e63-8894-a9e630d7d982 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "POST /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.324098 Oct 28 12:34:57.994491 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 325/641] 10.222.0.62 () {60 vars in 1322 bytes} [Thu Oct 28 12:34:57 2021] POST /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:34:58.035535 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-3a88ab94-e4c1-49b6-a73d-d30bcbff0a49 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-835547677", "imageRef": "575f28c8-0af2-4973-b3d9-a249e2400c6e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "91b3814f-2032-4bff-af3a-f4aaffcf631a"}], "security_groups": [{"name": "tempest-securitygroup--233159015"}], "key_name": "tempest-keypair-216996260", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:34:58.132042 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.network.neutron [None req-3a88ab94-e4c1-49b6-a73d-d30bcbff0a49 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] validate_networks() for [('91b3814f-2032-4bff-af3a-f4aaffcf631a', None, None, None, None, None)] {{(pid=115876) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:34:58.523740 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-3a88ab94-e4c1-49b6-a73d-d30bcbff0a49 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Flavor limits 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:34:58.524312 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-3a88ab94-e4c1-49b6-a73d-d30bcbff0a49 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Image limits 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:34:58.525004 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-3a88ab94-e4c1-49b6-a73d-d30bcbff0a49 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Flavor pref 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:34:58.525853 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-3a88ab94-e4c1-49b6-a73d-d30bcbff0a49 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Image pref 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:34:58.526519 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-3a88ab94-e4c1-49b6-a73d-d30bcbff0a49 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:34:58.536375 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3a88ab94-e4c1-49b6-a73d-d30bcbff0a49 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:58.536841 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3a88ab94-e4c1-49b6-a73d-d30bcbff0a49 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:58.537632 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3a88ab94-e4c1-49b6-a73d-d30bcbff0a49 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:58.538067 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3a88ab94-e4c1-49b6-a73d-d30bcbff0a49 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:58.555511 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-3a88ab94-e4c1-49b6-a73d-d30bcbff0a49 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Getting quotas for project 0ae5fd59e495402c829af6819f873149. Resources: {'cores', 'instances', 'ram'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:34:58.559659 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-3a88ab94-e4c1-49b6-a73d-d30bcbff0a49 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Getting quotas for user 4d38f499bdf74241a876e06ca3e05503 and project 0ae5fd59e495402c829af6819f873149. Resources: {'cores', 'instances', 'ram'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:34:58.571891 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-3a88ab94-e4c1-49b6-a73d-d30bcbff0a49 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Going to run 1 instances... {{(pid=115876) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:34:58.575422 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-3a88ab94-e4c1-49b6-a73d-d30bcbff0a49 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='575f28c8-0af2-4973-b3d9-a249e2400c6e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:34:58.625446 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-3a88ab94-e4c1-49b6-a73d-d30bcbff0a49 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.594600 Oct 28 12:34:58.626106 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 317/642] 10.222.0.62 () {62 vars in 1187 bytes} [Thu Oct 28 12:34:58 2021] POST /compute/v2.1/servers => generated 401 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 28 12:34:58.637053 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-36ed6fac-e684-4a5a-a12c-c9fa92462e02 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:58.637731 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-36ed6fac-e684-4a5a-a12c-c9fa92462e02 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:58.693081 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-36ed6fac-e684-4a5a-a12c-c9fa92462e02 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:58.700370 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-36ed6fac-e684-4a5a-a12c-c9fa92462e02 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:58.701915 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-36ed6fac-e684-4a5a-a12c-c9fa92462e02 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:58.703023 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-36ed6fac-e684-4a5a-a12c-c9fa92462e02 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1280 microversion: 2.20 time: 0.070568 Oct 28 12:34:58.703585 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 326/643] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:34:58 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1280 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:34:59.721744 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-a533fa13-6586-412a-a36c-41ae5afb0678 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:34:59.722324 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-a533fa13-6586-412a-a36c-41ae5afb0678 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:34:59.728665 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a533fa13-6586-412a-a36c-41ae5afb0678 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:59.729133 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a533fa13-6586-412a-a36c-41ae5afb0678 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:59.729901 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a533fa13-6586-412a-a36c-41ae5afb0678 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:34:59.730321 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a533fa13-6586-412a-a36c-41ae5afb0678 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:34:59.812983 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-a533fa13-6586-412a-a36c-41ae5afb0678 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:59.826828 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-a533fa13-6586-412a-a36c-41ae5afb0678 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:59.828404 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-a533fa13-6586-412a-a36c-41ae5afb0678 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:34:59.829647 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-a533fa13-6586-412a-a36c-41ae5afb0678 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1350 microversion: 2.20 time: 0.112323 Oct 28 12:34:59.831689 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 318/644] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:34:59 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1350 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:35:00.849754 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-e235ffbe-2a9d-4001-91ed-09979d81a55d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:00.850806 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-e235ffbe-2a9d-4001-91ed-09979d81a55d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:00.857321 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e235ffbe-2a9d-4001-91ed-09979d81a55d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:00.857759 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e235ffbe-2a9d-4001-91ed-09979d81a55d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:00.858525 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e235ffbe-2a9d-4001-91ed-09979d81a55d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:00.858947 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e235ffbe-2a9d-4001-91ed-09979d81a55d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:01.084068 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-e235ffbe-2a9d-4001-91ed-09979d81a55d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:01.092539 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-e235ffbe-2a9d-4001-91ed-09979d81a55d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:01.094132 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-e235ffbe-2a9d-4001-91ed-09979d81a55d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:01.095708 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-e235ffbe-2a9d-4001-91ed-09979d81a55d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1405 microversion: 2.20 time: 0.250228 Oct 28 12:35:01.096235 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 327/645] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:35:00 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1405 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:35:01.392105 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-84b311fa-4bc6-4407-9262-6bdfa8d0036f req-50c30ee0-21aa-4f77-9bed-33f0a6d3d2f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726", "tag": "c25d48e4-43fb-464d-a891-6f40b7296a25"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:01.393724 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:35:01.393724 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:35:01.403909 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-84b311fa-4bc6-4407-9262-6bdfa8d0036f req-50c30ee0-21aa-4f77-9bed-33f0a6d3d2f0 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:01.404415 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-84b311fa-4bc6-4407-9262-6bdfa8d0036f req-50c30ee0-21aa-4f77-9bed-33f0a6d3d2f0 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:01.450391 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-84b311fa-4bc6-4407-9262-6bdfa8d0036f req-50c30ee0-21aa-4f77-9bed-33f0a6d3d2f0 service nova] Creating event network-changed:c25d48e4-43fb-464d-a891-6f40b7296a25 for instance c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 on hv-cinder-81514 Oct 28 12:35:01.456335 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-84b311fa-4bc6-4407-9262-6bdfa8d0036f req-50c30ee0-21aa-4f77-9bed-33f0a6d3d2f0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067854 Oct 28 12:35:01.457623 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 319/646] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:35:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:35:02.115945 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-34494302-d1f1-4c1d-9bea-6dbcb2812d8d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:02.116653 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-34494302-d1f1-4c1d-9bea-6dbcb2812d8d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:02.124772 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-34494302-d1f1-4c1d-9bea-6dbcb2812d8d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:02.125472 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-34494302-d1f1-4c1d-9bea-6dbcb2812d8d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:02.126776 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-34494302-d1f1-4c1d-9bea-6dbcb2812d8d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:02.127629 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-34494302-d1f1-4c1d-9bea-6dbcb2812d8d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:02.353466 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-34494302-d1f1-4c1d-9bea-6dbcb2812d8d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:02.362537 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-34494302-d1f1-4c1d-9bea-6dbcb2812d8d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:02.365095 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-34494302-d1f1-4c1d-9bea-6dbcb2812d8d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:02.366229 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-34494302-d1f1-4c1d-9bea-6dbcb2812d8d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1405 microversion: 2.20 time: 0.254423 Oct 28 12:35:02.366792 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 328/647] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:35:02 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1405 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:35:03.384637 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-72f5a777-5533-45a6-a276-3ec9aedd3159 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:03.385441 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-72f5a777-5533-45a6-a276-3ec9aedd3159 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:03.392252 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-72f5a777-5533-45a6-a276-3ec9aedd3159 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:03.392704 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-72f5a777-5533-45a6-a276-3ec9aedd3159 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:03.393587 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-72f5a777-5533-45a6-a276-3ec9aedd3159 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:03.394061 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-72f5a777-5533-45a6-a276-3ec9aedd3159 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:03.515253 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-72f5a777-5533-45a6-a276-3ec9aedd3159 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:03.527137 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-72f5a777-5533-45a6-a276-3ec9aedd3159 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:03.529674 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-72f5a777-5533-45a6-a276-3ec9aedd3159 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:03.531090 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-72f5a777-5533-45a6-a276-3ec9aedd3159 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1405 microversion: 2.20 time: 0.150455 Oct 28 12:35:03.532028 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 320/648] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:35:03 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:35:04.553104 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-7a8a5b12-a034-43f2-af82-2978671948a9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:04.554145 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-7a8a5b12-a034-43f2-af82-2978671948a9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:04.565240 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7a8a5b12-a034-43f2-af82-2978671948a9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:04.565844 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7a8a5b12-a034-43f2-af82-2978671948a9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:04.566632 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7a8a5b12-a034-43f2-af82-2978671948a9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:04.567069 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7a8a5b12-a034-43f2-af82-2978671948a9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:04.706437 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-7a8a5b12-a034-43f2-af82-2978671948a9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:04.715217 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-7a8a5b12-a034-43f2-af82-2978671948a9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:04.716708 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-7a8a5b12-a034-43f2-af82-2978671948a9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:04.717871 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-7a8a5b12-a034-43f2-af82-2978671948a9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1405 microversion: 2.20 time: 0.171254 Oct 28 12:35:04.718504 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 329/649] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:35:04 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:35:05.738679 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-b0c79c96-9724-4718-8c1d-20c9d9742d9f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:05.739250 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-b0c79c96-9724-4718-8c1d-20c9d9742d9f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:05.746113 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b0c79c96-9724-4718-8c1d-20c9d9742d9f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:05.746545 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b0c79c96-9724-4718-8c1d-20c9d9742d9f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:05.747301 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b0c79c96-9724-4718-8c1d-20c9d9742d9f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:05.747719 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b0c79c96-9724-4718-8c1d-20c9d9742d9f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:05.888856 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-b0c79c96-9724-4718-8c1d-20c9d9742d9f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:05.897412 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-b0c79c96-9724-4718-8c1d-20c9d9742d9f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:05.898857 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-b0c79c96-9724-4718-8c1d-20c9d9742d9f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:05.899953 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-b0c79c96-9724-4718-8c1d-20c9d9742d9f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1405 microversion: 2.20 time: 0.165926 Oct 28 12:35:05.900690 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 321/650] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:35:05 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:35:06.917658 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-a3468833-5d3f-4807-92a8-3feaba079324 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:06.918256 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-a3468833-5d3f-4807-92a8-3feaba079324 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:06.924808 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a3468833-5d3f-4807-92a8-3feaba079324 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:06.925193 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a3468833-5d3f-4807-92a8-3feaba079324 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:06.925968 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a3468833-5d3f-4807-92a8-3feaba079324 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:06.926386 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a3468833-5d3f-4807-92a8-3feaba079324 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:07.058928 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-a3468833-5d3f-4807-92a8-3feaba079324 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:07.067349 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-a3468833-5d3f-4807-92a8-3feaba079324 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:07.068997 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-a3468833-5d3f-4807-92a8-3feaba079324 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:07.070190 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-a3468833-5d3f-4807-92a8-3feaba079324 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1405 microversion: 2.20 time: 0.156215 Oct 28 12:35:07.070763 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 330/651] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:35:06 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:35:07.637073 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-069d40ec-02e9-4ef4-b665-684bb68662ad tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01db5a36-6b2f-4703-bb2c-c2b5e12183d1"}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:07.638144 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-069d40ec-02e9-4ef4-b665-684bb68662ad tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 9d962dac-e3a8-4f73-bc9e-bc11692b0250] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:07.644961 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-069d40ec-02e9-4ef4-b665-684bb68662ad tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:07.645393 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-069d40ec-02e9-4ef4-b665-684bb68662ad tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:07.646170 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-069d40ec-02e9-4ef4-b665-684bb68662ad tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:07.646600 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-069d40ec-02e9-4ef4-b665-684bb68662ad tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:07.736370 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.wsgi [None req-069d40ec-02e9-4ef4-b665-684bb68662ad tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] HTTP exception thrown: Invalid volume: volume 01db5a36-6b2f-4703-bb2c-c2b5e12183d1 is already attached to instances: 9d962dac-e3a8-4f73-bc9e-bc11692b0250 Oct 28 12:35:07.737016 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-069d40ec-02e9-4ef4-b665-684bb68662ad tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Returning 400 to user: Invalid volume: volume 01db5a36-6b2f-4703-bb2c-c2b5e12183d1 is already attached to instances: 9d962dac-e3a8-4f73-bc9e-bc11692b0250 {{(pid=115876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:35:07.738015 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-069d40ec-02e9-4ef4-b665-684bb68662ad tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "POST /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104800 Oct 28 12:35:07.738563 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 322/652] 10.222.0.62 () {60 vars in 1322 bytes} [Thu Oct 28 12:35:07 2021] POST /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 12:35:07.811006 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-53a5fc1c-20d8-4d3b-aba8-f986aef2cb89 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:07.811616 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-53a5fc1c-20d8-4d3b-aba8-f986aef2cb89 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 9d962dac-e3a8-4f73-bc9e-bc11692b0250] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:07.821034 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-53a5fc1c-20d8-4d3b-aba8-f986aef2cb89 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:07.822005 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-53a5fc1c-20d8-4d3b-aba8-f986aef2cb89 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:07.823587 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-53a5fc1c-20d8-4d3b-aba8-f986aef2cb89 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:07.824213 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-53a5fc1c-20d8-4d3b-aba8-f986aef2cb89 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:07.912995 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.objects.instance [None req-53a5fc1c-20d8-4d3b-aba8-f986aef2cb89 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lazy-loading 'services' on Instance uuid 9d962dac-e3a8-4f73-bc9e-bc11692b0250 {{(pid=115877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:35:08.001608 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-53a5fc1c-20d8-4d3b-aba8-f986aef2cb89 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "DELETE /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250/os-volume_attachments/01db5a36-6b2f-4703-bb2c-c2b5e12183d1" status: 202 len: 0 microversion: 2.1 time: 0.196940 Oct 28 12:35:08.002454 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 331/653] 10.222.0.62 () {58 vars in 1415 bytes} [Thu Oct 28 12:35:07 2021] DELETE /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250/os-volume_attachments/01db5a36-6b2f-4703-bb2c-c2b5e12183d1 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:35:08.011428 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-7906b5c2-940b-4be2-842a-7777688d472c tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:08.012346 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-7906b5c2-940b-4be2-842a-7777688d472c tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 9d962dac-e3a8-4f73-bc9e-bc11692b0250] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:08.018393 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7906b5c2-940b-4be2-842a-7777688d472c tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:08.019171 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7906b5c2-940b-4be2-842a-7777688d472c tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:08.019602 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7906b5c2-940b-4be2-842a-7777688d472c tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:08.020068 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7906b5c2-940b-4be2-842a-7777688d472c tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:08.052900 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-7906b5c2-940b-4be2-842a-7777688d472c tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045847 Oct 28 12:35:08.053372 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 323/654] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Oct 28 12:35:08 2021] GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:35:08.087987 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-08047bea-8eba-41e7-bb20-b7faa9a224f1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:08.088677 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-08047bea-8eba-41e7-bb20-b7faa9a224f1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:08.095344 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-08047bea-8eba-41e7-bb20-b7faa9a224f1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:08.095787 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-08047bea-8eba-41e7-bb20-b7faa9a224f1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:08.096662 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-08047bea-8eba-41e7-bb20-b7faa9a224f1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:08.097131 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-08047bea-8eba-41e7-bb20-b7faa9a224f1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:08.225338 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-08047bea-8eba-41e7-bb20-b7faa9a224f1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:08.236222 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-08047bea-8eba-41e7-bb20-b7faa9a224f1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:08.238725 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-08047bea-8eba-41e7-bb20-b7faa9a224f1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:08.240390 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-08047bea-8eba-41e7-bb20-b7faa9a224f1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1405 microversion: 2.20 time: 0.156276 Oct 28 12:35:08.241274 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 332/655] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:35:08 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:35:09.067738 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-b4e43722-04a1-449d-bc69-44304e7ddc8f tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:09.068643 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-b4e43722-04a1-449d-bc69-44304e7ddc8f tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 9d962dac-e3a8-4f73-bc9e-bc11692b0250] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:09.075275 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b4e43722-04a1-449d-bc69-44304e7ddc8f tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:09.075718 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b4e43722-04a1-449d-bc69-44304e7ddc8f tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:09.076481 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b4e43722-04a1-449d-bc69-44304e7ddc8f tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:09.076949 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b4e43722-04a1-449d-bc69-44304e7ddc8f tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:09.106016 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-b4e43722-04a1-449d-bc69-44304e7ddc8f tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043381 Oct 28 12:35:09.106590 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 324/656] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Oct 28 12:35:09 2021] GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:35:09.259371 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-0e104b3e-e1bf-41f1-99c3-b19be8935eed tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:09.260135 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-0e104b3e-e1bf-41f1-99c3-b19be8935eed tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:09.268177 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0e104b3e-e1bf-41f1-99c3-b19be8935eed tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:09.268807 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0e104b3e-e1bf-41f1-99c3-b19be8935eed tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:09.269565 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0e104b3e-e1bf-41f1-99c3-b19be8935eed tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:09.270000 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0e104b3e-e1bf-41f1-99c3-b19be8935eed tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:09.408596 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-0e104b3e-e1bf-41f1-99c3-b19be8935eed tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:09.416542 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-0e104b3e-e1bf-41f1-99c3-b19be8935eed tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:09.418059 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-0e104b3e-e1bf-41f1-99c3-b19be8935eed tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:09.419144 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-0e104b3e-e1bf-41f1-99c3-b19be8935eed tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1405 microversion: 2.20 time: 0.164251 Oct 28 12:35:09.419827 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 333/657] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:35:09 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:35:09.733884 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-d60f309b-8a81-469a-a1d9-479b9ba26603 req-91f6475f-4f1c-4ef4-85ff-3e6824ecea36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726", "name": "network-vif-plugged", "status": "completed", "tag": "c25d48e4-43fb-464d-a891-6f40b7296a25"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:09.735377 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:35:09.735377 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:35:09.743090 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-d60f309b-8a81-469a-a1d9-479b9ba26603 req-91f6475f-4f1c-4ef4-85ff-3e6824ecea36 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:09.743525 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-d60f309b-8a81-469a-a1d9-479b9ba26603 req-91f6475f-4f1c-4ef4-85ff-3e6824ecea36 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:09.756191 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-d60f309b-8a81-469a-a1d9-479b9ba26603 req-91f6475f-4f1c-4ef4-85ff-3e6824ecea36 service nova] Creating event network-vif-plugged:c25d48e4-43fb-464d-a891-6f40b7296a25 for instance c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 on hv-cinder-81514 Oct 28 12:35:09.761067 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-d60f309b-8a81-469a-a1d9-479b9ba26603 req-91f6475f-4f1c-4ef4-85ff-3e6824ecea36 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031013 Oct 28 12:35:09.761662 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 325/658] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:35:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:35:10.121706 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-22788c49-5f1a-4e81-bc8a-cdbbb7f77e3a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:10.123325 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-22788c49-5f1a-4e81-bc8a-cdbbb7f77e3a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 9d962dac-e3a8-4f73-bc9e-bc11692b0250] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:10.133646 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-22788c49-5f1a-4e81-bc8a-cdbbb7f77e3a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:10.134385 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-22788c49-5f1a-4e81-bc8a-cdbbb7f77e3a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:10.135638 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-22788c49-5f1a-4e81-bc8a-cdbbb7f77e3a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:10.136345 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-22788c49-5f1a-4e81-bc8a-cdbbb7f77e3a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:10.169257 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-22788c49-5f1a-4e81-bc8a-cdbbb7f77e3a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053884 Oct 28 12:35:10.169829 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 334/659] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Oct 28 12:35:10 2021] GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:35:10.437911 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-21470f08-eb11-41a7-a74e-b19f5eb4af31 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:10.438585 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-21470f08-eb11-41a7-a74e-b19f5eb4af31 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:10.445896 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-21470f08-eb11-41a7-a74e-b19f5eb4af31 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:10.446331 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-21470f08-eb11-41a7-a74e-b19f5eb4af31 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:10.447097 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-21470f08-eb11-41a7-a74e-b19f5eb4af31 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:10.447515 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-21470f08-eb11-41a7-a74e-b19f5eb4af31 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:10.599395 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-21470f08-eb11-41a7-a74e-b19f5eb4af31 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:10.607792 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-21470f08-eb11-41a7-a74e-b19f5eb4af31 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:10.609341 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-21470f08-eb11-41a7-a74e-b19f5eb4af31 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:10.610444 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-21470f08-eb11-41a7-a74e-b19f5eb4af31 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1405 microversion: 2.20 time: 0.176668 Oct 28 12:35:10.611004 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 326/660] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:35:10 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:35:11.181954 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-ea68d079-dbff-49c9-9631-15b7f44f10c9 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:11.182913 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-ea68d079-dbff-49c9-9631-15b7f44f10c9 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 9d962dac-e3a8-4f73-bc9e-bc11692b0250] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:11.189460 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ea68d079-dbff-49c9-9631-15b7f44f10c9 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:11.189908 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ea68d079-dbff-49c9-9631-15b7f44f10c9 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:11.190860 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ea68d079-dbff-49c9-9631-15b7f44f10c9 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:11.191121 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ea68d079-dbff-49c9-9631-15b7f44f10c9 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:11.221561 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-ea68d079-dbff-49c9-9631-15b7f44f10c9 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043827 Oct 28 12:35:11.222130 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 335/661] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Oct 28 12:35:11 2021] GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:35:11.628321 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-6ab06b21-8edb-42df-949b-238ead8f4cc6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:11.629301 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-6ab06b21-8edb-42df-949b-238ead8f4cc6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:11.637733 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6ab06b21-8edb-42df-949b-238ead8f4cc6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:11.638383 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6ab06b21-8edb-42df-949b-238ead8f4cc6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:11.639933 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6ab06b21-8edb-42df-949b-238ead8f4cc6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:11.640648 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6ab06b21-8edb-42df-949b-238ead8f4cc6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:11.789266 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-6ab06b21-8edb-42df-949b-238ead8f4cc6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:11.802302 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-6ab06b21-8edb-42df-949b-238ead8f4cc6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:11.804511 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-6ab06b21-8edb-42df-949b-238ead8f4cc6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:11.806691 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-6ab06b21-8edb-42df-949b-238ead8f4cc6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1405 microversion: 2.20 time: 0.181853 Oct 28 12:35:11.807382 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 327/662] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:35:11 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1405 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:35:12.237354 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-16c74cc9-57ee-4200-8b15-d678c5a11f70 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:12.238842 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-16c74cc9-57ee-4200-8b15-d678c5a11f70 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 9d962dac-e3a8-4f73-bc9e-bc11692b0250] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:12.245581 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-16c74cc9-57ee-4200-8b15-d678c5a11f70 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:12.246018 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-16c74cc9-57ee-4200-8b15-d678c5a11f70 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:12.246772 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-16c74cc9-57ee-4200-8b15-d678c5a11f70 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:12.247196 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-16c74cc9-57ee-4200-8b15-d678c5a11f70 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:12.276113 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-16c74cc9-57ee-4200-8b15-d678c5a11f70 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045226 Oct 28 12:35:12.276663 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 336/663] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Oct 28 12:35:12 2021] GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:35:12.435116 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-28b8d293-59cd-48d7-95cc-e714508598ad tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1253560283", "imageRef": "575f28c8-0af2-4973-b3d9-a249e2400c6e", "flavorRef": "452", "networks": [{"uuid": "e80a2853-2c5f-4e30-b57e-4bb32d36cb7b"}]}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:12.493273 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.network.neutron [None req-28b8d293-59cd-48d7-95cc-e714508598ad tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] validate_networks() for [('e80a2853-2c5f-4e30-b57e-4bb32d36cb7b', None, None, None, None, None)] {{(pid=115876) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:35:12.829086 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-cc80ae90-be3f-49d8-9b26-7a3155a4511d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:12.829902 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-cc80ae90-be3f-49d8-9b26-7a3155a4511d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:12.836665 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-cc80ae90-be3f-49d8-9b26-7a3155a4511d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:12.837117 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-cc80ae90-be3f-49d8-9b26-7a3155a4511d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:12.838129 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-cc80ae90-be3f-49d8-9b26-7a3155a4511d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:12.838570 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-cc80ae90-be3f-49d8-9b26-7a3155a4511d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:12.883541 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-28b8d293-59cd-48d7-95cc-e714508598ad tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Flavor limits 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:35:12.884040 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-28b8d293-59cd-48d7-95cc-e714508598ad tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Image limits 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:35:12.884399 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-28b8d293-59cd-48d7-95cc-e714508598ad tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Flavor pref 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:35:12.884823 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-28b8d293-59cd-48d7-95cc-e714508598ad tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Image pref 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:35:12.885227 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-28b8d293-59cd-48d7-95cc-e714508598ad tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:35:12.895201 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-28b8d293-59cd-48d7-95cc-e714508598ad tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:12.895638 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-28b8d293-59cd-48d7-95cc-e714508598ad tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:12.896429 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-28b8d293-59cd-48d7-95cc-e714508598ad tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:12.896897 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-28b8d293-59cd-48d7-95cc-e714508598ad tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:12.913903 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-28b8d293-59cd-48d7-95cc-e714508598ad tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Getting quotas for project 36003ac4ee5e4de5b4ef1ed104c55b6c. Resources: {'cores', 'instances', 'ram'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:35:12.918308 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-28b8d293-59cd-48d7-95cc-e714508598ad tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Getting quotas for user ec86adff43114c36a65f2bb590e4f6e8 and project 36003ac4ee5e4de5b4ef1ed104c55b6c. Resources: {'cores', 'instances', 'ram'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:35:12.929168 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-28b8d293-59cd-48d7-95cc-e714508598ad tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Going to run 1 instances... {{(pid=115876) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:35:12.931925 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-28b8d293-59cd-48d7-95cc-e714508598ad tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: d081053d-6631-45f9-b636-6967469f5a72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='575f28c8-0af2-4973-b3d9-a249e2400c6e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:35:12.962775 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-cc80ae90-be3f-49d8-9b26-7a3155a4511d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:12.971273 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-cc80ae90-be3f-49d8-9b26-7a3155a4511d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:12.973091 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-cc80ae90-be3f-49d8-9b26-7a3155a4511d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:12.974191 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-cc80ae90-be3f-49d8-9b26-7a3155a4511d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1405 microversion: 2.20 time: 0.149280 Oct 28 12:35:12.974755 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 337/664] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:35:12 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1405 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:35:12.991285 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-28b8d293-59cd-48d7-95cc-e714508598ad tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.559760 Oct 28 12:35:12.991935 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 328/665] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Oct 28 12:35:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 12:35:13.001767 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-8882f74c-0d04-48c5-b2cc-72e08a757848 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:13.002347 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-8882f74c-0d04-48c5-b2cc-72e08a757848 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: d081053d-6631-45f9-b636-6967469f5a72] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:13.053482 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-8882f74c-0d04-48c5-b2cc-72e08a757848 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:13.060704 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-8882f74c-0d04-48c5-b2cc-72e08a757848 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72" status: 200 len: 1218 microversion: 2.1 time: 0.062568 Oct 28 12:35:13.061364 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 338/666] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:12 2021] GET /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72 => generated 1218 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:35:13.998955 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-df93ed44-2357-4f0d-a058-540d01d25c8f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:13.999842 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-df93ed44-2357-4f0d-a058-540d01d25c8f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:14.007575 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-df93ed44-2357-4f0d-a058-540d01d25c8f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:14.008009 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-df93ed44-2357-4f0d-a058-540d01d25c8f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:14.008765 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-df93ed44-2357-4f0d-a058-540d01d25c8f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:14.009224 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-df93ed44-2357-4f0d-a058-540d01d25c8f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:14.078252 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-665c9238-cd85-4b0c-bdef-328d00e713e0 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:14.078822 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-665c9238-cd85-4b0c-bdef-328d00e713e0 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: d081053d-6631-45f9-b636-6967469f5a72] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:14.086589 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-665c9238-cd85-4b0c-bdef-328d00e713e0 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:14.087053 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-665c9238-cd85-4b0c-bdef-328d00e713e0 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:14.087829 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-665c9238-cd85-4b0c-bdef-328d00e713e0 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:14.088259 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-665c9238-cd85-4b0c-bdef-328d00e713e0 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:14.162732 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-665c9238-cd85-4b0c-bdef-328d00e713e0 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:14.166565 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-df93ed44-2357-4f0d-a058-540d01d25c8f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:14.169781 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-665c9238-cd85-4b0c-bdef-328d00e713e0 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72" status: 200 len: 1222 microversion: 2.1 time: 0.095139 Oct 28 12:35:14.172368 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 339/667] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:14 2021] GET /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72 => generated 1222 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:35:14.178175 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-df93ed44-2357-4f0d-a058-540d01d25c8f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:14.180584 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-df93ed44-2357-4f0d-a058-540d01d25c8f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:14.181761 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-df93ed44-2357-4f0d-a058-540d01d25c8f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1405 microversion: 2.20 time: 0.189082 Oct 28 12:35:14.182324 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 329/668] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:35:13 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1405 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:35:15.187036 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-09584deb-e47c-4ffa-9113-d147a241bd11 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:15.187645 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-09584deb-e47c-4ffa-9113-d147a241bd11 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: d081053d-6631-45f9-b636-6967469f5a72] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:15.194872 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-09584deb-e47c-4ffa-9113-d147a241bd11 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:15.195319 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-09584deb-e47c-4ffa-9113-d147a241bd11 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:15.196100 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-09584deb-e47c-4ffa-9113-d147a241bd11 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:15.196531 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-09584deb-e47c-4ffa-9113-d147a241bd11 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:15.199349 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-1a611dcc-71f3-45e6-b7d0-766b9fc9b5dd tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:15.199964 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-1a611dcc-71f3-45e6-b7d0-766b9fc9b5dd tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:15.206884 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1a611dcc-71f3-45e6-b7d0-766b9fc9b5dd tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:15.207596 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1a611dcc-71f3-45e6-b7d0-766b9fc9b5dd tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:15.208355 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1a611dcc-71f3-45e6-b7d0-766b9fc9b5dd tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:15.208792 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1a611dcc-71f3-45e6-b7d0-766b9fc9b5dd tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:15.273541 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-09584deb-e47c-4ffa-9113-d147a241bd11 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:15.281366 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-09584deb-e47c-4ffa-9113-d147a241bd11 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72" status: 200 len: 1270 microversion: 2.1 time: 0.098132 Oct 28 12:35:15.282306 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 340/669] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:15 2021] GET /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72 => generated 1270 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:15.453845 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-1a611dcc-71f3-45e6-b7d0-766b9fc9b5dd tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:15.461798 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-1a611dcc-71f3-45e6-b7d0-766b9fc9b5dd tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:15.463282 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-1a611dcc-71f3-45e6-b7d0-766b9fc9b5dd tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:15.464438 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-1a611dcc-71f3-45e6-b7d0-766b9fc9b5dd tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1596 microversion: 2.20 time: 0.268884 Oct 28 12:35:15.476820 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 330/670] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:35:15 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1596 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:35:15.481970 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-120a7f16-4c85-47af-82e0-03377c5e46df tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:15.482638 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-120a7f16-4c85-47af-82e0-03377c5e46df tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:15.489124 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-120a7f16-4c85-47af-82e0-03377c5e46df tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:15.489574 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-120a7f16-4c85-47af-82e0-03377c5e46df tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:15.490333 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-120a7f16-4c85-47af-82e0-03377c5e46df tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:15.490763 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-120a7f16-4c85-47af-82e0-03377c5e46df tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:15.595223 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-120a7f16-4c85-47af-82e0-03377c5e46df tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.117264 Oct 28 12:35:15.595864 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 341/671] 10.222.0.62 () {60 vars in 1315 bytes} [Thu Oct 28 12:35:15 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:35:16.298089 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-4e1c307d-d4e0-401b-8d58-4f80f674efb3 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:16.298700 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-4e1c307d-d4e0-401b-8d58-4f80f674efb3 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: d081053d-6631-45f9-b636-6967469f5a72] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:16.307109 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4e1c307d-d4e0-401b-8d58-4f80f674efb3 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:16.309459 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4e1c307d-d4e0-401b-8d58-4f80f674efb3 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:16.310428 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4e1c307d-d4e0-401b-8d58-4f80f674efb3 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:16.312311 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4e1c307d-d4e0-401b-8d58-4f80f674efb3 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:16.538195 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-4e1c307d-d4e0-401b-8d58-4f80f674efb3 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:16.548064 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-4e1c307d-d4e0-401b-8d58-4f80f674efb3 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72" status: 200 len: 1318 microversion: 2.1 time: 0.253946 Oct 28 12:35:16.556786 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 331/672] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:16 2021] GET /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72 => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:16.730903 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-463fe50b-47eb-4393-8566-766e1794b636 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:16.734893 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-5cebe7d7-dec4-49c3-a044-601aa52097b8 req-bebeb856-b3fc-4554-a257-ca5707c9885e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726", "tag": "c25d48e4-43fb-464d-a891-6f40b7296a25"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:16.735786 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-463fe50b-47eb-4393-8566-766e1794b636 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:16.740509 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:35:16.740509 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:35:16.747096 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-463fe50b-47eb-4393-8566-766e1794b636 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:16.747473 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-463fe50b-47eb-4393-8566-766e1794b636 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:16.748241 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-463fe50b-47eb-4393-8566-766e1794b636 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:16.748431 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-5cebe7d7-dec4-49c3-a044-601aa52097b8 req-bebeb856-b3fc-4554-a257-ca5707c9885e service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:16.748668 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-463fe50b-47eb-4393-8566-766e1794b636 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:16.749361 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-5cebe7d7-dec4-49c3-a044-601aa52097b8 req-bebeb856-b3fc-4554-a257-ca5707c9885e service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:16.765342 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-5cebe7d7-dec4-49c3-a044-601aa52097b8 req-bebeb856-b3fc-4554-a257-ca5707c9885e service nova] Creating event network-changed:c25d48e4-43fb-464d-a891-6f40b7296a25 for instance c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 on hv-cinder-81514 Oct 28 12:35:16.772440 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-5cebe7d7-dec4-49c3-a044-601aa52097b8 req-bebeb856-b3fc-4554-a257-ca5707c9885e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042267 Oct 28 12:35:16.773684 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 332/673] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:35:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:35:16.831809 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-463fe50b-47eb-4393-8566-766e1794b636 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 14 microversion: 2.20 time: 0.106546 Oct 28 12:35:16.832598 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 342/674] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:16 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:17.084858 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-1795acf7-2738-4de4-8f3e-43649cfe8ac5 req-b17f61e3-6a74-422d-b336-f18e7a0d2ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d081053d-6631-45f9-b636-6967469f5a72", "tag": "ac8f927f-20fb-4502-8417-782a383b150f"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:17.087870 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:35:17.087870 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:35:17.110790 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-1795acf7-2738-4de4-8f3e-43649cfe8ac5 req-b17f61e3-6a74-422d-b336-f18e7a0d2ad4 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:17.111528 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-1795acf7-2738-4de4-8f3e-43649cfe8ac5 req-b17f61e3-6a74-422d-b336-f18e7a0d2ad4 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:17.123995 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-1795acf7-2738-4de4-8f3e-43649cfe8ac5 req-b17f61e3-6a74-422d-b336-f18e7a0d2ad4 service nova] Creating event network-changed:ac8f927f-20fb-4502-8417-782a383b150f for instance d081053d-6631-45f9-b636-6967469f5a72 on hv-cinder-81514 Oct 28 12:35:17.129635 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-1795acf7-2738-4de4-8f3e-43649cfe8ac5 req-b17f61e3-6a74-422d-b336-f18e7a0d2ad4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051545 Oct 28 12:35:17.130898 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 333/675] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:35:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:35:17.567086 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-f5c96eeb-bf7e-4b82-9853-8a427e9c270a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:17.568000 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-f5c96eeb-bf7e-4b82-9853-8a427e9c270a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: d081053d-6631-45f9-b636-6967469f5a72] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:17.575547 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f5c96eeb-bf7e-4b82-9853-8a427e9c270a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:17.576200 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f5c96eeb-bf7e-4b82-9853-8a427e9c270a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:17.577221 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f5c96eeb-bf7e-4b82-9853-8a427e9c270a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:17.577719 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f5c96eeb-bf7e-4b82-9853-8a427e9c270a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:17.795564 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-f5c96eeb-bf7e-4b82-9853-8a427e9c270a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:17.804000 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-f5c96eeb-bf7e-4b82-9853-8a427e9c270a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72" status: 200 len: 1318 microversion: 2.1 time: 0.241378 Oct 28 12:35:17.814487 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 343/676] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:17 2021] GET /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:17.843862 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-7267b54c-a0ec-44ec-8c20-32b3a49b2e16 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:17.844886 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-7267b54c-a0ec-44ec-8c20-32b3a49b2e16 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:17.851494 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7267b54c-a0ec-44ec-8c20-32b3a49b2e16 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:17.851933 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7267b54c-a0ec-44ec-8c20-32b3a49b2e16 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:17.852695 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7267b54c-a0ec-44ec-8c20-32b3a49b2e16 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:17.853355 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7267b54c-a0ec-44ec-8c20-32b3a49b2e16 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:17.917741 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-7267b54c-a0ec-44ec-8c20-32b3a49b2e16 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 14 microversion: 2.20 time: 0.077943 Oct 28 12:35:17.918462 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 334/677] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:17 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:18.823283 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-53fa2571-788b-4e7a-b9e8-23c25f7b0ac4 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:18.824015 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-53fa2571-788b-4e7a-b9e8-23c25f7b0ac4 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: d081053d-6631-45f9-b636-6967469f5a72] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:18.830842 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-53fa2571-788b-4e7a-b9e8-23c25f7b0ac4 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:18.831298 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-53fa2571-788b-4e7a-b9e8-23c25f7b0ac4 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:18.832044 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-53fa2571-788b-4e7a-b9e8-23c25f7b0ac4 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:18.832474 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-53fa2571-788b-4e7a-b9e8-23c25f7b0ac4 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:18.929129 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-50241018-d998-4a3b-9cca-dab92d2143b7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:18.930579 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-50241018-d998-4a3b-9cca-dab92d2143b7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:18.937753 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-50241018-d998-4a3b-9cca-dab92d2143b7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:18.938344 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-50241018-d998-4a3b-9cca-dab92d2143b7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:18.939165 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-50241018-d998-4a3b-9cca-dab92d2143b7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:18.939593 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-50241018-d998-4a3b-9cca-dab92d2143b7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:18.963810 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-53fa2571-788b-4e7a-b9e8-23c25f7b0ac4 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:18.972249 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-53fa2571-788b-4e7a-b9e8-23c25f7b0ac4 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72" status: 200 len: 1318 microversion: 2.1 time: 0.154161 Oct 28 12:35:18.972845 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 344/678] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:18 2021] GET /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:19.009786 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-50241018-d998-4a3b-9cca-dab92d2143b7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 14 microversion: 2.20 time: 0.084639 Oct 28 12:35:19.010402 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 335/679] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:18 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:35:19.195519 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 12:35:19.195713 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: Thu Oct 28 12:35:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 12:35:19.992433 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-4de55fb2-776d-460f-9c49-70dfa082a76e tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:19.993178 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-4de55fb2-776d-460f-9c49-70dfa082a76e tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: d081053d-6631-45f9-b636-6967469f5a72] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:20.003251 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4de55fb2-776d-460f-9c49-70dfa082a76e tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:20.003759 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4de55fb2-776d-460f-9c49-70dfa082a76e tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:20.004688 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4de55fb2-776d-460f-9c49-70dfa082a76e tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:20.005189 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4de55fb2-776d-460f-9c49-70dfa082a76e tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:20.021268 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-a535de6a-6867-4400-969d-d93aa43ffe97 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:20.022275 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-a535de6a-6867-4400-969d-d93aa43ffe97 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:20.030015 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a535de6a-6867-4400-969d-d93aa43ffe97 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:20.030366 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a535de6a-6867-4400-969d-d93aa43ffe97 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:20.031129 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a535de6a-6867-4400-969d-d93aa43ffe97 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:20.031565 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a535de6a-6867-4400-969d-d93aa43ffe97 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:20.094553 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-a535de6a-6867-4400-969d-d93aa43ffe97 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 14 microversion: 2.20 time: 0.077168 Oct 28 12:35:20.097808 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 336/680] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:20 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:35:20.135242 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-4de55fb2-776d-460f-9c49-70dfa082a76e tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:20.144487 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-4de55fb2-776d-460f-9c49-70dfa082a76e tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72" status: 200 len: 1318 microversion: 2.1 time: 0.157858 Oct 28 12:35:20.145129 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 345/681] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:19 2021] GET /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:21.107222 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-ab7c3de7-0545-43cc-a56b-ba175c8d37a6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:21.109014 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-ab7c3de7-0545-43cc-a56b-ba175c8d37a6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:21.115393 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ab7c3de7-0545-43cc-a56b-ba175c8d37a6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:21.116165 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ab7c3de7-0545-43cc-a56b-ba175c8d37a6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:21.117247 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ab7c3de7-0545-43cc-a56b-ba175c8d37a6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:21.117647 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ab7c3de7-0545-43cc-a56b-ba175c8d37a6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:21.162069 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-962294b4-1c1b-49fd-a244-88daccffbf43 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:21.162823 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-962294b4-1c1b-49fd-a244-88daccffbf43 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: d081053d-6631-45f9-b636-6967469f5a72] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:21.169483 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-962294b4-1c1b-49fd-a244-88daccffbf43 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:21.169934 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-962294b4-1c1b-49fd-a244-88daccffbf43 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:21.170704 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-962294b4-1c1b-49fd-a244-88daccffbf43 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:21.171128 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-962294b4-1c1b-49fd-a244-88daccffbf43 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:21.185554 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-ab7c3de7-0545-43cc-a56b-ba175c8d37a6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 14 microversion: 2.20 time: 0.082944 Oct 28 12:35:21.186320 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 337/682] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:21 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:21.301856 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-962294b4-1c1b-49fd-a244-88daccffbf43 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:21.311758 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-962294b4-1c1b-49fd-a244-88daccffbf43 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72" status: 200 len: 1318 microversion: 2.1 time: 0.153369 Oct 28 12:35:21.312345 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 346/683] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:21 2021] GET /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:35:22.128102 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-e1d36849-17b7-450a-b525-bc6e25b8ace1 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:22.128709 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-e1d36849-17b7-450a-b525-bc6e25b8ace1 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a02b0570-d3b8-4fe1-aa09-199f6525ac0c] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:22.138159 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e1d36849-17b7-450a-b525-bc6e25b8ace1 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:22.138586 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e1d36849-17b7-450a-b525-bc6e25b8ace1 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:22.139337 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e1d36849-17b7-450a-b525-bc6e25b8ace1 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:22.139754 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e1d36849-17b7-450a-b525-bc6e25b8ace1 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:22.171067 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-e1d36849-17b7-450a-b525-bc6e25b8ace1 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a02b0570-d3b8-4fe1-aa09-199f6525ac0c] Going to try to terminate instance {{(pid=115876) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:35:22.197416 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-9ce59901-1f4a-4afe-acaf-177104f4cf36 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:22.198320 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-9ce59901-1f4a-4afe-acaf-177104f4cf36 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:22.205258 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9ce59901-1f4a-4afe-acaf-177104f4cf36 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:22.205684 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9ce59901-1f4a-4afe-acaf-177104f4cf36 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:22.206556 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9ce59901-1f4a-4afe-acaf-177104f4cf36 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:22.207006 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9ce59901-1f4a-4afe-acaf-177104f4cf36 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:22.252229 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-e1d36849-17b7-450a-b525-bc6e25b8ace1 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c" status: 204 len: 0 microversion: 2.1 time: 0.129704 Oct 28 12:35:22.253427 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 338/684] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Oct 28 12:35:22 2021] DELETE /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:35:22.262491 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-26c71eb7-3b3d-4007-8655-185384635ee0 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:22.263237 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-26c71eb7-3b3d-4007-8655-185384635ee0 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a02b0570-d3b8-4fe1-aa09-199f6525ac0c] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:22.270194 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-26c71eb7-3b3d-4007-8655-185384635ee0 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:22.270639 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-26c71eb7-3b3d-4007-8655-185384635ee0 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:22.271409 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-26c71eb7-3b3d-4007-8655-185384635ee0 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:22.271835 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-26c71eb7-3b3d-4007-8655-185384635ee0 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:22.284256 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-9ce59901-1f4a-4afe-acaf-177104f4cf36 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 14 microversion: 2.20 time: 0.090289 Oct 28 12:35:22.288026 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 347/685] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:22 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:35:22.332339 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-1f9339a2-4b9b-4942-a918-929b7041d08c tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:22.333058 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-1f9339a2-4b9b-4942-a918-929b7041d08c tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: d081053d-6631-45f9-b636-6967469f5a72] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:22.339862 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1f9339a2-4b9b-4942-a918-929b7041d08c tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:22.340306 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1f9339a2-4b9b-4942-a918-929b7041d08c tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:22.341125 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1f9339a2-4b9b-4942-a918-929b7041d08c tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:22.341747 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1f9339a2-4b9b-4942-a918-929b7041d08c tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:22.424012 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-26c71eb7-3b3d-4007-8655-185384635ee0 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:22.432352 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-26c71eb7-3b3d-4007-8655-185384635ee0 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c" status: 200 len: 1577 microversion: 2.1 time: 0.174574 Oct 28 12:35:22.432941 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 339/686] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:22 2021] GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c => generated 1577 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:35:22.482679 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-1f9339a2-4b9b-4942-a918-929b7041d08c tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:22.490073 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-1f9339a2-4b9b-4942-a918-929b7041d08c tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72" status: 200 len: 1318 microversion: 2.1 time: 0.164614 Oct 28 12:35:22.490607 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 348/687] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:22 2021] GET /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:22.650325 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-9463703b-def6-4ed6-bdb5-0d778d945fa7 req-b8446073-6fd2-41f8-a949-e0e9a3018406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d081053d-6631-45f9-b636-6967469f5a72", "name": "network-vif-plugged", "status": "completed", "tag": "ac8f927f-20fb-4502-8417-782a383b150f"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:22.652349 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:35:22.652349 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:35:22.660915 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-9463703b-def6-4ed6-bdb5-0d778d945fa7 req-b8446073-6fd2-41f8-a949-e0e9a3018406 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:22.661452 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-9463703b-def6-4ed6-bdb5-0d778d945fa7 req-b8446073-6fd2-41f8-a949-e0e9a3018406 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:22.673911 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-9463703b-def6-4ed6-bdb5-0d778d945fa7 req-b8446073-6fd2-41f8-a949-e0e9a3018406 service nova] Creating event network-vif-plugged:ac8f927f-20fb-4502-8417-782a383b150f for instance d081053d-6631-45f9-b636-6967469f5a72 on hv-cinder-81514 Oct 28 12:35:22.678662 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-9463703b-def6-4ed6-bdb5-0d778d945fa7 req-b8446073-6fd2-41f8-a949-e0e9a3018406 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032392 Oct 28 12:35:22.679363 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 340/688] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:35:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:35:23.300068 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-f87c6d54-9487-4ca1-9ad8-62a529a251ba tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:23.301697 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-f87c6d54-9487-4ca1-9ad8-62a529a251ba tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:23.309777 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f87c6d54-9487-4ca1-9ad8-62a529a251ba tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:23.310219 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f87c6d54-9487-4ca1-9ad8-62a529a251ba tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:23.310977 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f87c6d54-9487-4ca1-9ad8-62a529a251ba tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:23.311403 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f87c6d54-9487-4ca1-9ad8-62a529a251ba tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:23.398756 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-f87c6d54-9487-4ca1-9ad8-62a529a251ba tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 14 microversion: 2.20 time: 0.104595 Oct 28 12:35:23.399636 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 349/689] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:23 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:23.450476 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-7babb752-855c-4957-b4b2-7354d33d09b3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:23.451170 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-7babb752-855c-4957-b4b2-7354d33d09b3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a02b0570-d3b8-4fe1-aa09-199f6525ac0c] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:23.458164 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7babb752-855c-4957-b4b2-7354d33d09b3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:23.458599 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7babb752-855c-4957-b4b2-7354d33d09b3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:23.459354 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7babb752-855c-4957-b4b2-7354d33d09b3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:23.459783 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7babb752-855c-4957-b4b2-7354d33d09b3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:23.507544 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-04d43356-2135-4c4f-ab44-06bf2fd79242 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:23.508239 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-04d43356-2135-4c4f-ab44-06bf2fd79242 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: d081053d-6631-45f9-b636-6967469f5a72] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:23.515545 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-04d43356-2135-4c4f-ab44-06bf2fd79242 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:23.515976 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-04d43356-2135-4c4f-ab44-06bf2fd79242 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:23.516745 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-04d43356-2135-4c4f-ab44-06bf2fd79242 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:23.517152 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-04d43356-2135-4c4f-ab44-06bf2fd79242 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:23.615647 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-7babb752-855c-4957-b4b2-7354d33d09b3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:23.623350 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-7babb752-855c-4957-b4b2-7354d33d09b3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c" status: 200 len: 1577 microversion: 2.1 time: 0.176908 Oct 28 12:35:23.623934 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 341/690] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:23 2021] GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:23.665210 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-04d43356-2135-4c4f-ab44-06bf2fd79242 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:23.672602 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-04d43356-2135-4c4f-ab44-06bf2fd79242 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72" status: 200 len: 1318 microversion: 2.1 time: 0.169139 Oct 28 12:35:23.673198 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 350/691] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:23 2021] GET /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:24.410708 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-6a2bb6ec-0a17-4170-a424-be6a32d7da4a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:24.411616 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-6a2bb6ec-0a17-4170-a424-be6a32d7da4a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:24.426033 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6a2bb6ec-0a17-4170-a424-be6a32d7da4a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:24.426753 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6a2bb6ec-0a17-4170-a424-be6a32d7da4a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:24.427567 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6a2bb6ec-0a17-4170-a424-be6a32d7da4a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:24.428220 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6a2bb6ec-0a17-4170-a424-be6a32d7da4a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:24.506804 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-6a2bb6ec-0a17-4170-a424-be6a32d7da4a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 14 microversion: 2.20 time: 0.099603 Oct 28 12:35:24.507894 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 342/692] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:24 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:35:24.643415 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-1d76a3d9-6cbf-43e0-974e-aa772a2bf731 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:24.644247 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-1d76a3d9-6cbf-43e0-974e-aa772a2bf731 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a02b0570-d3b8-4fe1-aa09-199f6525ac0c] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:24.651294 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1d76a3d9-6cbf-43e0-974e-aa772a2bf731 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:24.651740 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1d76a3d9-6cbf-43e0-974e-aa772a2bf731 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:24.652517 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1d76a3d9-6cbf-43e0-974e-aa772a2bf731 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:24.653399 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1d76a3d9-6cbf-43e0-974e-aa772a2bf731 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:24.697753 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-40e3439f-9b60-40d7-a2d9-aa5d40aa270e tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:24.698345 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-40e3439f-9b60-40d7-a2d9-aa5d40aa270e tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: d081053d-6631-45f9-b636-6967469f5a72] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:24.705664 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-40e3439f-9b60-40d7-a2d9-aa5d40aa270e tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:24.706096 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-40e3439f-9b60-40d7-a2d9-aa5d40aa270e tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:24.706865 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-40e3439f-9b60-40d7-a2d9-aa5d40aa270e tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:24.707281 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-40e3439f-9b60-40d7-a2d9-aa5d40aa270e tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:25.014420 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-1d76a3d9-6cbf-43e0-974e-aa772a2bf731 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:25.018470 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-40e3439f-9b60-40d7-a2d9-aa5d40aa270e tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:25.022712 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-1d76a3d9-6cbf-43e0-974e-aa772a2bf731 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c" status: 200 len: 1577 microversion: 2.1 time: 0.385141 Oct 28 12:35:25.023321 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 351/693] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:24 2021] GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c => generated 1577 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:25.026308 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-40e3439f-9b60-40d7-a2d9-aa5d40aa270e tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72" status: 200 len: 1507 microversion: 2.1 time: 0.332621 Oct 28 12:35:25.027050 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 343/694] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:24 2021] GET /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72 => generated 1507 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:25.505798 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-c26f0a51-e266-4752-8cdc-1d7d580acf45 req-8db362eb-4139-48d8-aa06-40b096cc6069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a02b0570-d3b8-4fe1-aa09-199f6525ac0c", "name": "network-vif-deleted", "tag": "d8c38e90-8225-4aaf-8322-139cc91fa0a9"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:25.507736 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:35:25.507736 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:35:25.518560 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-c26f0a51-e266-4752-8cdc-1d7d580acf45 req-8db362eb-4139-48d8-aa06-40b096cc6069 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:25.519072 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-c26f0a51-e266-4752-8cdc-1d7d580acf45 req-8db362eb-4139-48d8-aa06-40b096cc6069 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:25.521963 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-6019e859-87df-442f-85f2-a84d8bb621f5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:25.523661 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-6019e859-87df-442f-85f2-a84d8bb621f5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:25.531667 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-c26f0a51-e266-4752-8cdc-1d7d580acf45 req-8db362eb-4139-48d8-aa06-40b096cc6069 service nova] Creating event network-vif-deleted:d8c38e90-8225-4aaf-8322-139cc91fa0a9 for instance a02b0570-d3b8-4fe1-aa09-199f6525ac0c on hv-cinder-81514 Oct 28 12:35:25.533274 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6019e859-87df-442f-85f2-a84d8bb621f5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:25.537535 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-c26f0a51-e266-4752-8cdc-1d7d580acf45 req-8db362eb-4139-48d8-aa06-40b096cc6069 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035841 Oct 28 12:35:25.538019 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6019e859-87df-442f-85f2-a84d8bb621f5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:25.539020 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 352/695] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:35:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:35:25.540042 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6019e859-87df-442f-85f2-a84d8bb621f5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:25.542179 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6019e859-87df-442f-85f2-a84d8bb621f5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:25.613656 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-6019e859-87df-442f-85f2-a84d8bb621f5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 14 microversion: 2.20 time: 0.099185 Oct 28 12:35:25.614331 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 344/696] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:25 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:26.040261 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-6242d4e1-ed1b-4b3e-aff1-30fe3ebc14aa tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:26.040906 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-6242d4e1-ed1b-4b3e-aff1-30fe3ebc14aa tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a02b0570-d3b8-4fe1-aa09-199f6525ac0c] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:26.047125 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6242d4e1-ed1b-4b3e-aff1-30fe3ebc14aa tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:26.047570 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6242d4e1-ed1b-4b3e-aff1-30fe3ebc14aa tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:26.048342 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6242d4e1-ed1b-4b3e-aff1-30fe3ebc14aa tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:26.048797 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6242d4e1-ed1b-4b3e-aff1-30fe3ebc14aa tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:26.079352 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6242d4e1-ed1b-4b3e-aff1-30fe3ebc14aa tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:26.079794 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6242d4e1-ed1b-4b3e-aff1-30fe3ebc14aa tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:26.080236 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.objects.instance [None req-6242d4e1-ed1b-4b3e-aff1-30fe3ebc14aa tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lazy-loading 'fault' on Instance uuid a02b0570-d3b8-4fe1-aa09-199f6525ac0c {{(pid=115877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:35:26.122540 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-6242d4e1-ed1b-4b3e-aff1-30fe3ebc14aa tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:26.130225 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-6242d4e1-ed1b-4b3e-aff1-30fe3ebc14aa tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c" status: 200 len: 1231 microversion: 2.1 time: 0.094203 Oct 28 12:35:26.130794 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 353/697] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:26 2021] GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c => generated 1231 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:26.376728 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-fcef25d1-51d5-43d7-8cb7-08237aaf69a1 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "636dc5fc-a186-4db0-b74d-7d7e67b0e480"}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:26.378015 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-fcef25d1-51d5-43d7-8cb7-08237aaf69a1 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: d081053d-6631-45f9-b636-6967469f5a72] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:26.385137 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fcef25d1-51d5-43d7-8cb7-08237aaf69a1 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:26.385787 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fcef25d1-51d5-43d7-8cb7-08237aaf69a1 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:26.386578 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fcef25d1-51d5-43d7-8cb7-08237aaf69a1 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:26.386997 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fcef25d1-51d5-43d7-8cb7-08237aaf69a1 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:26.627122 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-c4378d5e-aa6c-4165-b426-94ef8abb137b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:26.628365 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-c4378d5e-aa6c-4165-b426-94ef8abb137b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:26.637094 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c4378d5e-aa6c-4165-b426-94ef8abb137b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:26.637835 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c4378d5e-aa6c-4165-b426-94ef8abb137b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:26.638845 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c4378d5e-aa6c-4165-b426-94ef8abb137b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:26.639394 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c4378d5e-aa6c-4165-b426-94ef8abb137b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:26.648655 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-fcef25d1-51d5-43d7-8cb7-08237aaf69a1 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "POST /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275878 Oct 28 12:35:26.657522 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 345/698] 10.222.0.62 () {60 vars in 1322 bytes} [Thu Oct 28 12:35:26 2021] POST /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:35:26.719113 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-c4378d5e-aa6c-4165-b426-94ef8abb137b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 14 microversion: 2.20 time: 0.096749 Oct 28 12:35:26.722484 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 354/699] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:26 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:27.148418 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-62ddb3ba-c5ce-43b3-83ab-e96f159c3ea1 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:27.149141 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-62ddb3ba-c5ce-43b3-83ab-e96f159c3ea1 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a02b0570-d3b8-4fe1-aa09-199f6525ac0c] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:27.156683 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-62ddb3ba-c5ce-43b3-83ab-e96f159c3ea1 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:27.156897 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-62ddb3ba-c5ce-43b3-83ab-e96f159c3ea1 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:27.157609 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-62ddb3ba-c5ce-43b3-83ab-e96f159c3ea1 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:27.158032 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-62ddb3ba-c5ce-43b3-83ab-e96f159c3ea1 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:27.181181 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.wsgi [None req-62ddb3ba-c5ce-43b3-83ab-e96f159c3ea1 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] HTTP exception thrown: Instance a02b0570-d3b8-4fe1-aa09-199f6525ac0c could not be found. Oct 28 12:35:27.181773 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-62ddb3ba-c5ce-43b3-83ab-e96f159c3ea1 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Returning 404 to user: Instance a02b0570-d3b8-4fe1-aa09-199f6525ac0c could not be found. {{(pid=115876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:35:27.182603 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-62ddb3ba-c5ce-43b3-83ab-e96f159c3ea1 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c" status: 404 len: 111 microversion: 2.1 time: 0.038899 Oct 28 12:35:27.183168 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 346/700] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:27 2021] GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:35:27.286376 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-7b60e13b-7d33-4d4e-9fd2-ff3d784c249a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-376517449", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1357312688", "security_groups": [{"name": "tempest-secgroup-smoke-1509298390"}], "block_device_mapping_v2": [{"uuid": "fc5409b6-41ea-4162-9eab-a6f9f0705297", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "21386cb8-b310-4d7a-bddd-fd2d5b5b89a3"}]}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:27.395773 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.network.neutron [None req-7b60e13b-7d33-4d4e-9fd2-ff3d784c249a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] validate_networks() for [('21386cb8-b310-4d7a-bddd-fd2d5b5b89a3', None, None, None, None, None)] {{(pid=115877) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:35:27.650375 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-4c6a4476-b523-4819-88c5-07a2c3988b2a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:27.651395 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-4c6a4476-b523-4819-88c5-07a2c3988b2a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:27.657501 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4c6a4476-b523-4819-88c5-07a2c3988b2a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:27.657941 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4c6a4476-b523-4819-88c5-07a2c3988b2a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:27.658732 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4c6a4476-b523-4819-88c5-07a2c3988b2a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:27.659154 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4c6a4476-b523-4819-88c5-07a2c3988b2a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:27.690885 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-4c6a4476-b523-4819-88c5-07a2c3988b2a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044209 Oct 28 12:35:27.691470 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 347/701] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Oct 28 12:35:27 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:35:27.732057 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-335bd29d-0b26-4394-b311-fcadd140fa09 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:27.733156 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-335bd29d-0b26-4394-b311-fcadd140fa09 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:27.740195 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-335bd29d-0b26-4394-b311-fcadd140fa09 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:27.740634 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-335bd29d-0b26-4394-b311-fcadd140fa09 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:27.741676 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-335bd29d-0b26-4394-b311-fcadd140fa09 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:27.742107 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-335bd29d-0b26-4394-b311-fcadd140fa09 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:27.829321 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-335bd29d-0b26-4394-b311-fcadd140fa09 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 14 microversion: 2.20 time: 0.101285 Oct 28 12:35:27.829932 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 348/702] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:27 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:35:27.836791 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-e884ced5-7c0f-40f3-808b-af9a7879f34b tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:27.837442 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-e884ced5-7c0f-40f3-808b-af9a7879f34b tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:27.844403 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e884ced5-7c0f-40f3-808b-af9a7879f34b tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:27.844884 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e884ced5-7c0f-40f3-808b-af9a7879f34b tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:27.845490 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-7b60e13b-7d33-4d4e-9fd2-ff3d784c249a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Flavor limits 0:0:0 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:35:27.845663 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e884ced5-7c0f-40f3-808b-af9a7879f34b tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:27.845904 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-7b60e13b-7d33-4d4e-9fd2-ff3d784c249a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Image limits 0:0:0 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:35:27.846091 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e884ced5-7c0f-40f3-808b-af9a7879f34b tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:27.846519 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-7b60e13b-7d33-4d4e-9fd2-ff3d784c249a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Flavor pref 0:0:0 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:35:27.846965 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-7b60e13b-7d33-4d4e-9fd2-ff3d784c249a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Image pref 0:0:0 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:35:27.847382 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-7b60e13b-7d33-4d4e-9fd2-ff3d784c249a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:35:27.857793 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7b60e13b-7d33-4d4e-9fd2-ff3d784c249a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:27.858376 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7b60e13b-7d33-4d4e-9fd2-ff3d784c249a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:27.859336 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7b60e13b-7d33-4d4e-9fd2-ff3d784c249a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:27.859832 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7b60e13b-7d33-4d4e-9fd2-ff3d784c249a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:27.879837 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.quota [None req-7b60e13b-7d33-4d4e-9fd2-ff3d784c249a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Getting quotas for project 70a330da99234af6b3a80df822d5067f. Resources: {'cores', 'instances', 'ram'} {{(pid=115877) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:35:27.884028 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-e884ced5-7c0f-40f3-808b-af9a7879f34b tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Going to try to terminate instance {{(pid=115876) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:35:27.886552 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.quota [None req-7b60e13b-7d33-4d4e-9fd2-ff3d784c249a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Getting quotas for user 4303ee654346434cb52fa498176297b1 and project 70a330da99234af6b3a80df822d5067f. Resources: {'cores', 'instances', 'ram'} {{(pid=115877) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:35:27.955181 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-7b60e13b-7d33-4d4e-9fd2-ff3d784c249a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Going to run 1 instances... {{(pid=115877) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:35:27.957577 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-7b60e13b-7d33-4d4e-9fd2-ff3d784c249a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: b81a4bfc-220f-4a70-b4a8-8da612c927fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fc5409b6-41ea-4162-9eab-a6f9f0705297',volume_size=None,volume_type=None)] {{(pid=115877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:35:27.985920 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-e884ced5-7c0f-40f3-808b-af9a7879f34b tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "DELETE /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 204 len: 0 microversion: 2.1 time: 0.154198 Oct 28 12:35:27.986956 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 349/703] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Oct 28 12:35:27 2021] DELETE /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:35:27.997697 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-f2b99c31-2915-4f23-a286-9269bc043d0e tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:27.997697 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-f2b99c31-2915-4f23-a286-9269bc043d0e tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:28.010676 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f2b99c31-2915-4f23-a286-9269bc043d0e tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:28.011106 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f2b99c31-2915-4f23-a286-9269bc043d0e tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:28.011955 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f2b99c31-2915-4f23-a286-9269bc043d0e tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:28.012408 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f2b99c31-2915-4f23-a286-9269bc043d0e tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:28.106342 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-7b60e13b-7d33-4d4e-9fd2-ff3d784c249a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.824056 Oct 28 12:35:28.107173 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 355/704] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Oct 28 12:35:27 2021] POST /compute/v2.1/servers => generated 406 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 12:35:28.116913 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-b65cddba-ea4b-4c53-be66-bb32c8bd6a72 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:28.117520 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-b65cddba-ea4b-4c53-be66-bb32c8bd6a72 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: b81a4bfc-220f-4a70-b4a8-8da612c927fb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:28.147846 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f2b99c31-2915-4f23-a286-9269bc043d0e tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:28.161869 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-f2b99c31-2915-4f23-a286-9269bc043d0e tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1671 microversion: 2.1 time: 0.169296 Oct 28 12:35:28.163273 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 350/705] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:27 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1671 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:35:28.181628 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-b65cddba-ea4b-4c53-be66-bb32c8bd6a72 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:28.188318 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-b65cddba-ea4b-4c53-be66-bb32c8bd6a72 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb" status: 200 len: 1094 microversion: 2.1 time: 0.075032 Oct 28 12:35:28.188907 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 356/706] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:28 2021] GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:28.840471 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-b7f51ebd-5515-435c-b234-1dbff9a7d65e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:28.841412 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-b7f51ebd-5515-435c-b234-1dbff9a7d65e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:28.847979 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b7f51ebd-5515-435c-b234-1dbff9a7d65e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:28.848438 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b7f51ebd-5515-435c-b234-1dbff9a7d65e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:28.849217 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b7f51ebd-5515-435c-b234-1dbff9a7d65e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:28.849644 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b7f51ebd-5515-435c-b234-1dbff9a7d65e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:28.924660 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-b7f51ebd-5515-435c-b234-1dbff9a7d65e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 14 microversion: 2.20 time: 0.087755 Oct 28 12:35:28.925351 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 351/707] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:28 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:29.180444 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-14fada0f-cdbc-4bd7-bca6-cd34b0bf1369 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:29.181344 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-14fada0f-cdbc-4bd7-bca6-cd34b0bf1369 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:29.188191 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-14fada0f-cdbc-4bd7-bca6-cd34b0bf1369 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:29.188747 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-14fada0f-cdbc-4bd7-bca6-cd34b0bf1369 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:29.189512 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-14fada0f-cdbc-4bd7-bca6-cd34b0bf1369 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:29.190814 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-14fada0f-cdbc-4bd7-bca6-cd34b0bf1369 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:29.205709 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-ea45a26a-58a0-4f73-ab1d-c6d84b29dac7 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:29.206798 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-ea45a26a-58a0-4f73-ab1d-c6d84b29dac7 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: b81a4bfc-220f-4a70-b4a8-8da612c927fb] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:29.215751 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ea45a26a-58a0-4f73-ab1d-c6d84b29dac7 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:29.216213 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ea45a26a-58a0-4f73-ab1d-c6d84b29dac7 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:29.217012 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ea45a26a-58a0-4f73-ab1d-c6d84b29dac7 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:29.217462 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ea45a26a-58a0-4f73-ab1d-c6d84b29dac7 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:29.303302 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-ea45a26a-58a0-4f73-ab1d-c6d84b29dac7 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:29.311302 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-ea45a26a-58a0-4f73-ab1d-c6d84b29dac7 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb" status: 200 len: 1210 microversion: 2.1 time: 0.109539 Oct 28 12:35:29.311867 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 352/708] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:29 2021] GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb => generated 1210 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:35:29.417102 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-14fada0f-cdbc-4bd7-bca6-cd34b0bf1369 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:29.425153 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-14fada0f-cdbc-4bd7-bca6-cd34b0bf1369 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1671 microversion: 2.1 time: 0.248732 Oct 28 12:35:29.425719 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 357/709] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:29 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1671 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:29.936134 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-8aaa7020-0423-46ee-8e8b-86eb3d20e73c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:29.937131 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-8aaa7020-0423-46ee-8e8b-86eb3d20e73c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:29.943708 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8aaa7020-0423-46ee-8e8b-86eb3d20e73c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:29.944147 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8aaa7020-0423-46ee-8e8b-86eb3d20e73c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:29.945056 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8aaa7020-0423-46ee-8e8b-86eb3d20e73c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:29.945475 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8aaa7020-0423-46ee-8e8b-86eb3d20e73c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:30.040237 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-8aaa7020-0423-46ee-8e8b-86eb3d20e73c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 6451 microversion: 2.20 time: 0.107528 Oct 28 12:35:30.041665 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 353/710] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:29 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 6451 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:35:30.328061 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-4ec44ac3-95fc-442c-9f8e-834ba486f11c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:30.328591 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-4ec44ac3-95fc-442c-9f8e-834ba486f11c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: b81a4bfc-220f-4a70-b4a8-8da612c927fb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:30.335297 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4ec44ac3-95fc-442c-9f8e-834ba486f11c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:30.335751 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4ec44ac3-95fc-442c-9f8e-834ba486f11c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:30.336560 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4ec44ac3-95fc-442c-9f8e-834ba486f11c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:30.337027 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4ec44ac3-95fc-442c-9f8e-834ba486f11c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:30.444050 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-1e8e735a-3c6c-4e2b-9db8-8f6b97c33250 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:30.444949 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-1e8e735a-3c6c-4e2b-9db8-8f6b97c33250 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:30.452237 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1e8e735a-3c6c-4e2b-9db8-8f6b97c33250 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:30.452761 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1e8e735a-3c6c-4e2b-9db8-8f6b97c33250 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:30.453650 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1e8e735a-3c6c-4e2b-9db8-8f6b97c33250 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:30.454177 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1e8e735a-3c6c-4e2b-9db8-8f6b97c33250 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:30.548000 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-4ec44ac3-95fc-442c-9f8e-834ba486f11c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:30.556652 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-4ec44ac3-95fc-442c-9f8e-834ba486f11c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb" status: 200 len: 1278 microversion: 2.1 time: 0.232502 Oct 28 12:35:30.557678 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 358/711] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:30 2021] GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb => generated 1278 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:30.689857 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-1e8e735a-3c6c-4e2b-9db8-8f6b97c33250 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:30.703869 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-1e8e735a-3c6c-4e2b-9db8-8f6b97c33250 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1671 microversion: 2.1 time: 0.263652 Oct 28 12:35:30.715069 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 354/712] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:30 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1671 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:30.927808 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-a199e3c9-7bcd-44ad-9889-6abf2fe693a9 req-a156567d-0c80-4231-a1a1-8c1815aad878 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b81a4bfc-220f-4a70-b4a8-8da612c927fb", "tag": "a302007e-59e1-42c9-9b5a-9b428e8140c9"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:30.930469 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:35:30.930469 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:35:30.939245 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-a199e3c9-7bcd-44ad-9889-6abf2fe693a9 req-a156567d-0c80-4231-a1a1-8c1815aad878 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:30.939846 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-a199e3c9-7bcd-44ad-9889-6abf2fe693a9 req-a156567d-0c80-4231-a1a1-8c1815aad878 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:30.969255 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-a199e3c9-7bcd-44ad-9889-6abf2fe693a9 req-a156567d-0c80-4231-a1a1-8c1815aad878 service nova] Creating event network-changed:a302007e-59e1-42c9-9b5a-9b428e8140c9 for instance b81a4bfc-220f-4a70-b4a8-8da612c927fb on hv-cinder-81514 Oct 28 12:35:30.978491 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-a199e3c9-7bcd-44ad-9889-6abf2fe693a9 req-a156567d-0c80-4231-a1a1-8c1815aad878 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056008 Oct 28 12:35:30.979432 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 359/713] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:35:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:35:31.053622 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-f7b661f0-d7f5-4a33-8378-a05316f97a0a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:31.055762 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-f7b661f0-d7f5-4a33-8378-a05316f97a0a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:31.062276 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f7b661f0-d7f5-4a33-8378-a05316f97a0a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:31.062678 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f7b661f0-d7f5-4a33-8378-a05316f97a0a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:31.063735 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f7b661f0-d7f5-4a33-8378-a05316f97a0a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:31.064190 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f7b661f0-d7f5-4a33-8378-a05316f97a0a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:31.161393 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-f7b661f0-d7f5-4a33-8378-a05316f97a0a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 12750 microversion: 2.20 time: 0.112001 Oct 28 12:35:31.166258 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 355/714] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:31 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 12750 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:35:31.413181 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-cc6389a2-0dda-44be-b07d-57cf0d2db6af req-1adefdd2-f723-4f1d-ad3c-4d85be48264e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b133627-e4a2-43dc-9613-8ef3d028862b", "name": "network-vif-deleted", "tag": "fe4d3fd7-9134-42f8-a93d-9cbe08ca530e"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:31.414859 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:35:31.414859 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:35:31.423115 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-cc6389a2-0dda-44be-b07d-57cf0d2db6af req-1adefdd2-f723-4f1d-ad3c-4d85be48264e service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:31.424009 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-cc6389a2-0dda-44be-b07d-57cf0d2db6af req-1adefdd2-f723-4f1d-ad3c-4d85be48264e service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:31.452373 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-cc6389a2-0dda-44be-b07d-57cf0d2db6af req-1adefdd2-f723-4f1d-ad3c-4d85be48264e service nova] Creating event network-vif-deleted:fe4d3fd7-9134-42f8-a93d-9cbe08ca530e for instance 1b133627-e4a2-43dc-9613-8ef3d028862b on hv-cinder-81514 Oct 28 12:35:31.458586 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-cc6389a2-0dda-44be-b07d-57cf0d2db6af req-1adefdd2-f723-4f1d-ad3c-4d85be48264e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049742 Oct 28 12:35:31.459846 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 360/715] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:35:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:35:31.575418 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-99591f84-5dc0-41cb-a71a-49f9a3412295 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:31.576468 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-99591f84-5dc0-41cb-a71a-49f9a3412295 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: b81a4bfc-220f-4a70-b4a8-8da612c927fb] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:31.586407 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-99591f84-5dc0-41cb-a71a-49f9a3412295 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:31.587129 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-99591f84-5dc0-41cb-a71a-49f9a3412295 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:31.588141 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-99591f84-5dc0-41cb-a71a-49f9a3412295 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:31.588570 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-99591f84-5dc0-41cb-a71a-49f9a3412295 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:31.722759 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-3c872289-bf42-4613-aa3e-0b0703785b99 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:31.723922 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-3c872289-bf42-4613-aa3e-0b0703785b99 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:31.731959 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3c872289-bf42-4613-aa3e-0b0703785b99 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:31.733640 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3c872289-bf42-4613-aa3e-0b0703785b99 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:31.735230 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3c872289-bf42-4613-aa3e-0b0703785b99 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:31.740746 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3c872289-bf42-4613-aa3e-0b0703785b99 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:31.775022 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3c872289-bf42-4613-aa3e-0b0703785b99 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:31.775686 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3c872289-bf42-4613-aa3e-0b0703785b99 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:31.776137 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.objects.instance [None req-3c872289-bf42-4613-aa3e-0b0703785b99 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lazy-loading 'fault' on Instance uuid 1b133627-e4a2-43dc-9613-8ef3d028862b {{(pid=115877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:35:31.807096 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-99591f84-5dc0-41cb-a71a-49f9a3412295 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:31.815174 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-99591f84-5dc0-41cb-a71a-49f9a3412295 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb" status: 200 len: 1278 microversion: 2.1 time: 0.244934 Oct 28 12:35:31.815919 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 356/716] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:31 2021] GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb => generated 1278 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:31.846644 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-3c872289-bf42-4613-aa3e-0b0703785b99 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:31.854102 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-3c872289-bf42-4613-aa3e-0b0703785b99 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 200 len: 1326 microversion: 2.1 time: 0.135785 Oct 28 12:35:31.863521 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 361/717] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:31 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 1326 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:35:32.174651 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-b75e76ed-a05c-4eea-b694-99fa3f4f27be tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:32.175554 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-b75e76ed-a05c-4eea-b694-99fa3f4f27be tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:32.182893 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b75e76ed-a05c-4eea-b694-99fa3f4f27be tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:32.183331 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b75e76ed-a05c-4eea-b694-99fa3f4f27be tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:32.184098 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b75e76ed-a05c-4eea-b694-99fa3f4f27be tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:32.184525 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b75e76ed-a05c-4eea-b694-99fa3f4f27be tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:32.266136 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-b75e76ed-a05c-4eea-b694-99fa3f4f27be tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 17498 microversion: 2.20 time: 0.096135 Oct 28 12:35:32.266958 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 357/718] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:32 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 17498 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:35:32.832968 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-115d70c8-eee2-4766-812d-3a61ea6a9080 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:32.833551 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-115d70c8-eee2-4766-812d-3a61ea6a9080 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: b81a4bfc-220f-4a70-b4a8-8da612c927fb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:32.840179 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-115d70c8-eee2-4766-812d-3a61ea6a9080 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:32.840613 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-115d70c8-eee2-4766-812d-3a61ea6a9080 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:32.841408 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-115d70c8-eee2-4766-812d-3a61ea6a9080 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:32.841931 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-115d70c8-eee2-4766-812d-3a61ea6a9080 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:32.872571 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-9ea3f066-d5ed-4cdd-857a-0565d835714e tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:32.873372 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-9ea3f066-d5ed-4cdd-857a-0565d835714e tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:32.882743 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9ea3f066-d5ed-4cdd-857a-0565d835714e tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:32.883288 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9ea3f066-d5ed-4cdd-857a-0565d835714e tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:32.884136 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9ea3f066-d5ed-4cdd-857a-0565d835714e tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:32.884567 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9ea3f066-d5ed-4cdd-857a-0565d835714e tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:32.898854 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.wsgi [None req-9ea3f066-d5ed-4cdd-857a-0565d835714e tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] HTTP exception thrown: Instance 1b133627-e4a2-43dc-9613-8ef3d028862b could not be found. Oct 28 12:35:32.899440 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-9ea3f066-d5ed-4cdd-857a-0565d835714e tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Returning 404 to user: Instance 1b133627-e4a2-43dc-9613-8ef3d028862b could not be found. {{(pid=115876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:35:32.900273 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-9ea3f066-d5ed-4cdd-857a-0565d835714e tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 404 len: 111 microversion: 2.1 time: 0.031753 Oct 28 12:35:32.900822 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 358/719] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:32 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:35:32.909030 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-88cb21c0-e1d0-4bbe-ac4a-2d6301bb89cb tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '.version_select at 0x7f4a7943ac10>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:32.927958 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-88cb21c0-e1d0-4bbe-ac4a-2d6301bb89cb tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-207466005" status: 202 len: 0 microversion: 2.1 time: 0.022458 Oct 28 12:35:32.932611 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 359/720] 10.222.0.62 () {58 vars in 1217 bytes} [Thu Oct 28 12:35:32 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-207466005 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:35:32.979486 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-115d70c8-eee2-4766-812d-3a61ea6a9080 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:32.988624 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-115d70c8-eee2-4766-812d-3a61ea6a9080 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb" status: 200 len: 1278 microversion: 2.1 time: 0.159318 Oct 28 12:35:32.989464 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 362/721] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:32 2021] GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:33.279249 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-7f989c7d-2cfb-4959-b6aa-b5dac7c2dbec tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:33.280260 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-7f989c7d-2cfb-4959-b6aa-b5dac7c2dbec tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:33.288209 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7f989c7d-2cfb-4959-b6aa-b5dac7c2dbec tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:33.289064 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7f989c7d-2cfb-4959-b6aa-b5dac7c2dbec tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:33.289817 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7f989c7d-2cfb-4959-b6aa-b5dac7c2dbec tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:33.290458 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7f989c7d-2cfb-4959-b6aa-b5dac7c2dbec tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:33.366944 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-7f989c7d-2cfb-4959-b6aa-b5dac7c2dbec tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 18208 microversion: 2.20 time: 0.091647 Oct 28 12:35:33.370818 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 360/722] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:33 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 18208 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:35:33.606553 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-a5896cb4-2976-463c-9e02-ee4f44dfb45a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'create', calling method: .version_select at 0x7f4a7948bee0>, body: {"keypair": {"name": "tempest-keypair-1011525555"}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:33.630655 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.quota [None req-a5896cb4-2976-463c-9e02-ee4f44dfb45a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Getting quotas for project c5337ec1ac12488aa4e8ecbab298da10. Resources: {'key_pairs'} {{(pid=115877) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:35:33.635764 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.quota [None req-a5896cb4-2976-463c-9e02-ee4f44dfb45a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Getting quotas for user 86f15cc4fe5a4148984af18a9a49fa31 and project c5337ec1ac12488aa4e8ecbab298da10. Resources: {'key_pairs'} {{(pid=115877) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:35:33.938303 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.quota [None req-a5896cb4-2976-463c-9e02-ee4f44dfb45a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Getting quotas for project c5337ec1ac12488aa4e8ecbab298da10. Resources: {'key_pairs'} {{(pid=115877) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:35:33.941755 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.quota [None req-a5896cb4-2976-463c-9e02-ee4f44dfb45a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Getting quotas for user 86f15cc4fe5a4148984af18a9a49fa31 and project c5337ec1ac12488aa4e8ecbab298da10. Resources: {'key_pairs'} {{(pid=115877) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:35:33.954611 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-a5896cb4-2976-463c-9e02-ee4f44dfb45a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.351640 Oct 28 12:35:33.955334 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 363/723] 10.222.0.62 () {60 vars in 1157 bytes} [Thu Oct 28 12:35:33 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:34.015247 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-b00896c7-c178-4115-9df5-7761c3e979ca tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:34.016020 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-b00896c7-c178-4115-9df5-7761c3e979ca tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: b81a4bfc-220f-4a70-b4a8-8da612c927fb] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:34.024237 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b00896c7-c178-4115-9df5-7761c3e979ca tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:34.024680 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b00896c7-c178-4115-9df5-7761c3e979ca tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:34.025478 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b00896c7-c178-4115-9df5-7761c3e979ca tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:34.025905 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b00896c7-c178-4115-9df5-7761c3e979ca tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:34.322472 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-f5535f54-8fc4-4cf0-9bb8-b3a74a9b0cf9 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:34.322834 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-f5535f54-8fc4-4cf0-9bb8-b3a74a9b0cf9 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: d081053d-6631-45f9-b636-6967469f5a72] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:34.328992 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f5535f54-8fc4-4cf0-9bb8-b3a74a9b0cf9 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:34.329421 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f5535f54-8fc4-4cf0-9bb8-b3a74a9b0cf9 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:34.330349 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f5535f54-8fc4-4cf0-9bb8-b3a74a9b0cf9 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:34.330772 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f5535f54-8fc4-4cf0-9bb8-b3a74a9b0cf9 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:34.400789 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-b00896c7-c178-4115-9df5-7761c3e979ca tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:34.408489 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-b00896c7-c178-4115-9df5-7761c3e979ca tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb" status: 200 len: 1266 microversion: 2.1 time: 0.399472 Oct 28 12:35:34.418587 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 361/724] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:34 2021] GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb => generated 1266 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:34.424464 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-4f68d554-50b2-41f7-98a7-b499afd2eecb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:34.426113 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-4f68d554-50b2-41f7-98a7-b499afd2eecb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:34.432913 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4f68d554-50b2-41f7-98a7-b499afd2eecb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:34.433362 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4f68d554-50b2-41f7-98a7-b499afd2eecb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:34.434134 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4f68d554-50b2-41f7-98a7-b499afd2eecb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:34.434549 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4f68d554-50b2-41f7-98a7-b499afd2eecb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:34.524981 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.objects.instance [None req-f5535f54-8fc4-4cf0-9bb8-b3a74a9b0cf9 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lazy-loading 'services' on Instance uuid d081053d-6631-45f9-b636-6967469f5a72 {{(pid=115877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:35:34.530988 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-4f68d554-50b2-41f7-98a7-b499afd2eecb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 20997 microversion: 2.20 time: 0.110789 Oct 28 12:35:34.535531 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 362/725] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:34 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 20997 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:35:34.600463 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-f5535f54-8fc4-4cf0-9bb8-b3a74a9b0cf9 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "DELETE /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72/os-volume_attachments/636dc5fc-a186-4db0-b74d-7d7e67b0e480" status: 202 len: 0 microversion: 2.1 time: 0.282305 Oct 28 12:35:34.601750 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 364/726] 10.222.0.62 () {58 vars in 1415 bytes} [Thu Oct 28 12:35:34 2021] DELETE /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72/os-volume_attachments/636dc5fc-a186-4db0-b74d-7d7e67b0e480 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:35:34.611843 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-8efb1edd-d4de-4c53-8f18-52cc7f302202 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:34.617864 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-8efb1edd-d4de-4c53-8f18-52cc7f302202 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: d081053d-6631-45f9-b636-6967469f5a72] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:34.627154 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8efb1edd-d4de-4c53-8f18-52cc7f302202 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:34.627677 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8efb1edd-d4de-4c53-8f18-52cc7f302202 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:34.628847 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8efb1edd-d4de-4c53-8f18-52cc7f302202 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:34.629287 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8efb1edd-d4de-4c53-8f18-52cc7f302202 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:34.663838 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-8efb1edd-d4de-4c53-8f18-52cc7f302202 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057542 Oct 28 12:35:34.664485 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 363/727] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Oct 28 12:35:34 2021] GET /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:35:35.410308 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-fcfefb7f-390a-4eee-86f0-1c900905f6dc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-69314343", "imageRef": "575f28c8-0af2-4973-b3d9-a249e2400c6e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c977e2aa-b8cb-4592-9494-ce66891f1b69"}], "security_groups": [{"name": "tempest-securitygroup--1617047200"}], "key_name": "tempest-keypair-1011525555", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:35.427079 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-bb7a6107-1e87-4647-8522-78ba90f5df3a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:35.427735 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-bb7a6107-1e87-4647-8522-78ba90f5df3a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: b81a4bfc-220f-4a70-b4a8-8da612c927fb] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:35.440817 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-bb7a6107-1e87-4647-8522-78ba90f5df3a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:35.441262 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-bb7a6107-1e87-4647-8522-78ba90f5df3a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:35.442090 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-bb7a6107-1e87-4647-8522-78ba90f5df3a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:35.442522 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-bb7a6107-1e87-4647-8522-78ba90f5df3a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:35.538966 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.network.neutron [None req-fcfefb7f-390a-4eee-86f0-1c900905f6dc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] validate_networks() for [('c977e2aa-b8cb-4592-9494-ce66891f1b69', None, None, None, None, None)] {{(pid=115877) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:35:35.656283 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-bb7a6107-1e87-4647-8522-78ba90f5df3a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:35.664313 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-bb7a6107-1e87-4647-8522-78ba90f5df3a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb" status: 200 len: 1266 microversion: 2.1 time: 0.241734 Oct 28 12:35:35.664917 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 364/728] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:35 2021] GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:35:35.673767 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-dbd71c36-1332-4b47-87ca-dc5b602b4521 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:35.673767 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-dbd71c36-1332-4b47-87ca-dc5b602b4521 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:35.676436 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-dbd71c36-1332-4b47-87ca-dc5b602b4521 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:35.677134 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-dbd71c36-1332-4b47-87ca-dc5b602b4521 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:35.677909 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-dbd71c36-1332-4b47-87ca-dc5b602b4521 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:35.678514 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-dbd71c36-1332-4b47-87ca-dc5b602b4521 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:35.764625 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-dbd71c36-1332-4b47-87ca-dc5b602b4521 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 22897 microversion: 2.20 time: 0.098299 Oct 28 12:35:35.765261 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 365/729] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:35 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 22897 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:35:35.770368 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-20bb93dc-7d6a-45dd-b191-29a345bc9632 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:35.771422 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-20bb93dc-7d6a-45dd-b191-29a345bc9632 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: d081053d-6631-45f9-b636-6967469f5a72] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:35.778583 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-20bb93dc-7d6a-45dd-b191-29a345bc9632 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:35.779023 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-20bb93dc-7d6a-45dd-b191-29a345bc9632 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:35.779796 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-20bb93dc-7d6a-45dd-b191-29a345bc9632 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:35.780220 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-20bb93dc-7d6a-45dd-b191-29a345bc9632 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:35.811247 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-20bb93dc-7d6a-45dd-b191-29a345bc9632 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044624 Oct 28 12:35:35.811817 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 366/730] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Oct 28 12:35:35 2021] GET /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:35:35.958362 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-fcfefb7f-390a-4eee-86f0-1c900905f6dc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Flavor limits 0:0:0 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:35:35.959065 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-fcfefb7f-390a-4eee-86f0-1c900905f6dc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Image limits 0:0:0 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:35:35.959612 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-fcfefb7f-390a-4eee-86f0-1c900905f6dc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Flavor pref 0:0:0 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:35:35.960066 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-fcfefb7f-390a-4eee-86f0-1c900905f6dc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Image pref 0:0:0 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:35:35.960527 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.virt.hardware [None req-fcfefb7f-390a-4eee-86f0-1c900905f6dc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:35:35.970175 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fcfefb7f-390a-4eee-86f0-1c900905f6dc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:35.970721 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fcfefb7f-390a-4eee-86f0-1c900905f6dc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:35.971557 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fcfefb7f-390a-4eee-86f0-1c900905f6dc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:35.972003 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fcfefb7f-390a-4eee-86f0-1c900905f6dc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:35.995591 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.quota [None req-fcfefb7f-390a-4eee-86f0-1c900905f6dc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Getting quotas for project c5337ec1ac12488aa4e8ecbab298da10. Resources: {'cores', 'instances', 'ram'} {{(pid=115877) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:35:35.999722 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.quota [None req-fcfefb7f-390a-4eee-86f0-1c900905f6dc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Getting quotas for user 86f15cc4fe5a4148984af18a9a49fa31 and project c5337ec1ac12488aa4e8ecbab298da10. Resources: {'cores', 'instances', 'ram'} {{(pid=115877) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:35:36.010796 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-fcfefb7f-390a-4eee-86f0-1c900905f6dc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Going to run 1 instances... {{(pid=115877) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:35:36.013267 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-fcfefb7f-390a-4eee-86f0-1c900905f6dc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='575f28c8-0af2-4973-b3d9-a249e2400c6e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:35:36.059392 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-fcfefb7f-390a-4eee-86f0-1c900905f6dc tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.653935 Oct 28 12:35:36.059959 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 365/731] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Oct 28 12:35:35 2021] POST /compute/v2.1/servers => generated 402 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 12:35:36.069916 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-259d288b-7dc9-4dd8-b520-2dcb64c2132a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:36.070645 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-259d288b-7dc9-4dd8-b520-2dcb64c2132a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:36.145248 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-259d288b-7dc9-4dd8-b520-2dcb64c2132a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:36.174511 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-259d288b-7dc9-4dd8-b520-2dcb64c2132a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638" status: 200 len: 1236 microversion: 2.1 time: 0.108012 Oct 28 12:35:36.175211 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 367/732] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:36 2021] GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638 => generated 1236 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:36.682751 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-8d9e2fa3-d33c-4fe4-bc82-b4a08559aa0d tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:36.683334 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-8d9e2fa3-d33c-4fe4-bc82-b4a08559aa0d tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: b81a4bfc-220f-4a70-b4a8-8da612c927fb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:36.694644 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8d9e2fa3-d33c-4fe4-bc82-b4a08559aa0d tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:36.695144 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8d9e2fa3-d33c-4fe4-bc82-b4a08559aa0d tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:36.695942 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8d9e2fa3-d33c-4fe4-bc82-b4a08559aa0d tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:36.696438 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8d9e2fa3-d33c-4fe4-bc82-b4a08559aa0d tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:36.777148 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-a3fc5339-d1d0-4d1f-b073-a7a1b6000efc tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:36.778063 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-a3fc5339-d1d0-4d1f-b073-a7a1b6000efc tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:36.785120 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a3fc5339-d1d0-4d1f-b073-a7a1b6000efc tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:36.785557 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a3fc5339-d1d0-4d1f-b073-a7a1b6000efc tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:36.786405 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a3fc5339-d1d0-4d1f-b073-a7a1b6000efc tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:36.787007 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a3fc5339-d1d0-4d1f-b073-a7a1b6000efc tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:36.829546 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-8d9e2fa3-d33c-4fe4-bc82-b4a08559aa0d tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:36.837111 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-8d9e2fa3-d33c-4fe4-bc82-b4a08559aa0d tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb" status: 200 len: 1266 microversion: 2.1 time: 0.159034 Oct 28 12:35:36.837677 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 366/733] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:36 2021] GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:36.869726 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-a3fc5339-d1d0-4d1f-b073-a7a1b6000efc tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 24011 microversion: 2.20 time: 0.096534 Oct 28 12:35:36.870258 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 368/734] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:36 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 24011 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:35:37.024823 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-1cfcbdd6-782d-4a42-83e7-db7cdcd230aa tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:37.025313 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-1cfcbdd6-782d-4a42-83e7-db7cdcd230aa tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: d081053d-6631-45f9-b636-6967469f5a72] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:37.031656 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1cfcbdd6-782d-4a42-83e7-db7cdcd230aa tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:37.032093 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1cfcbdd6-782d-4a42-83e7-db7cdcd230aa tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:37.032905 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1cfcbdd6-782d-4a42-83e7-db7cdcd230aa tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:37.033332 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1cfcbdd6-782d-4a42-83e7-db7cdcd230aa tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:37.059406 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-1cfcbdd6-782d-4a42-83e7-db7cdcd230aa tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: d081053d-6631-45f9-b636-6967469f5a72] Going to try to terminate instance {{(pid=115877) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:35:37.157958 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-1cfcbdd6-782d-4a42-83e7-db7cdcd230aa tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "DELETE /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72" status: 204 len: 0 microversion: 2.1 time: 0.137830 Oct 28 12:35:37.160775 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 367/735] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Oct 28 12:35:37 2021] DELETE /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:35:37.167915 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-d1d92690-aa96-4952-bc99-b7a5304c16e4 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:37.168627 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-d1d92690-aa96-4952-bc99-b7a5304c16e4 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: d081053d-6631-45f9-b636-6967469f5a72] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:37.175518 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d1d92690-aa96-4952-bc99-b7a5304c16e4 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:37.176174 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d1d92690-aa96-4952-bc99-b7a5304c16e4 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:37.176985 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d1d92690-aa96-4952-bc99-b7a5304c16e4 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:37.177409 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d1d92690-aa96-4952-bc99-b7a5304c16e4 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:37.195530 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-2f4bbd68-7451-4f46-a785-5c1ad32a16e7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:37.197332 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-2f4bbd68-7451-4f46-a785-5c1ad32a16e7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:37.206727 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2f4bbd68-7451-4f46-a785-5c1ad32a16e7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:37.207525 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2f4bbd68-7451-4f46-a785-5c1ad32a16e7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:37.209410 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2f4bbd68-7451-4f46-a785-5c1ad32a16e7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:37.210812 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2f4bbd68-7451-4f46-a785-5c1ad32a16e7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:37.296773 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-2f4bbd68-7451-4f46-a785-5c1ad32a16e7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:37.304642 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-2f4bbd68-7451-4f46-a785-5c1ad32a16e7 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638" status: 200 len: 1306 microversion: 2.1 time: 0.116368 Oct 28 12:35:37.305405 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 368/736] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:37 2021] GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638 => generated 1306 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:35:37.386940 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-d1d92690-aa96-4952-bc99-b7a5304c16e4 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:37.400685 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-d1d92690-aa96-4952-bc99-b7a5304c16e4 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72" status: 200 len: 1513 microversion: 2.1 time: 0.236706 Oct 28 12:35:37.401982 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 369/737] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:37 2021] GET /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72 => generated 1513 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:37.853974 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-8e657e55-7bcb-49f6-94eb-0972dfc3da1c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:37.854565 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-8e657e55-7bcb-49f6-94eb-0972dfc3da1c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: b81a4bfc-220f-4a70-b4a8-8da612c927fb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:37.861280 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8e657e55-7bcb-49f6-94eb-0972dfc3da1c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:37.861832 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8e657e55-7bcb-49f6-94eb-0972dfc3da1c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:37.862501 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8e657e55-7bcb-49f6-94eb-0972dfc3da1c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:37.862937 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8e657e55-7bcb-49f6-94eb-0972dfc3da1c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:37.882194 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-e1204429-bedd-4f6a-a961-f506e9244feb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:37.884280 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-e1204429-bedd-4f6a-a961-f506e9244feb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:37.891324 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e1204429-bedd-4f6a-a961-f506e9244feb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:37.891855 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e1204429-bedd-4f6a-a961-f506e9244feb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:37.892792 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e1204429-bedd-4f6a-a961-f506e9244feb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:37.898226 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e1204429-bedd-4f6a-a961-f506e9244feb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:37.984748 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-e1204429-bedd-4f6a-a961-f506e9244feb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 25237 microversion: 2.20 time: 0.106954 Oct 28 12:35:37.985484 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 370/738] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:37 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 25237 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:35:38.068045 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-8e657e55-7bcb-49f6-94eb-0972dfc3da1c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:38.083138 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-8e657e55-7bcb-49f6-94eb-0972dfc3da1c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb" status: 200 len: 1266 microversion: 2.1 time: 0.232813 Oct 28 12:35:38.083698 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 369/739] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:37 2021] GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:38.323147 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-59cac870-be4d-485e-bf9d-0765aa362e14 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:38.323758 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-59cac870-be4d-485e-bf9d-0765aa362e14 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:38.332601 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-59cac870-be4d-485e-bf9d-0765aa362e14 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:38.333368 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-59cac870-be4d-485e-bf9d-0765aa362e14 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:38.334933 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-59cac870-be4d-485e-bf9d-0765aa362e14 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:38.335545 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-59cac870-be4d-485e-bf9d-0765aa362e14 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:38.420970 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-b663d711-ba71-4d0b-8ee5-b43ba944e3d8 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:38.421863 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-b663d711-ba71-4d0b-8ee5-b43ba944e3d8 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: d081053d-6631-45f9-b636-6967469f5a72] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:38.433103 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b663d711-ba71-4d0b-8ee5-b43ba944e3d8 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:38.433680 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b663d711-ba71-4d0b-8ee5-b43ba944e3d8 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:38.434938 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b663d711-ba71-4d0b-8ee5-b43ba944e3d8 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:38.435628 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b663d711-ba71-4d0b-8ee5-b43ba944e3d8 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:38.874928 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-59cac870-be4d-485e-bf9d-0765aa362e14 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:38.877633 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-b663d711-ba71-4d0b-8ee5-b43ba944e3d8 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:38.883767 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-59cac870-be4d-485e-bf9d-0765aa362e14 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638" status: 200 len: 1362 microversion: 2.1 time: 0.565130 Oct 28 12:35:38.884684 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 371/740] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:38 2021] GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638 => generated 1362 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:38.895412 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-b663d711-ba71-4d0b-8ee5-b43ba944e3d8 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72" status: 200 len: 1513 microversion: 2.1 time: 0.480223 Oct 28 12:35:38.895993 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 370/741] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:38 2021] GET /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72 => generated 1513 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:38.996730 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-5d821174-5949-4f71-8d14-e906e7e782ef tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:38.998397 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-5d821174-5949-4f71-8d14-e906e7e782ef tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:39.010241 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-49337dc2-5aef-4c45-b5e8-d5efc7d2c26c req-c2f112be-4450-40ad-9f19-7cbf4d891ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3173757b-e9bd-478b-93ee-55b43fa30638", "tag": "07d4f5a8-2fdd-4368-8fd4-1b5d39b142a1"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:39.012138 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:35:39.012138 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:35:39.018180 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5d821174-5949-4f71-8d14-e906e7e782ef tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:39.019022 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5d821174-5949-4f71-8d14-e906e7e782ef tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:39.020004 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5d821174-5949-4f71-8d14-e906e7e782ef tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:39.020593 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5d821174-5949-4f71-8d14-e906e7e782ef tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:39.023947 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-49337dc2-5aef-4c45-b5e8-d5efc7d2c26c req-c2f112be-4450-40ad-9f19-7cbf4d891ac7 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:39.027574 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-49337dc2-5aef-4c45-b5e8-d5efc7d2c26c req-c2f112be-4450-40ad-9f19-7cbf4d891ac7 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:39.066754 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-49337dc2-5aef-4c45-b5e8-d5efc7d2c26c req-c2f112be-4450-40ad-9f19-7cbf4d891ac7 service nova] Creating event network-changed:07d4f5a8-2fdd-4368-8fd4-1b5d39b142a1 for instance 3173757b-e9bd-478b-93ee-55b43fa30638 on hv-cinder-81514 Oct 28 12:35:39.073577 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-49337dc2-5aef-4c45-b5e8-d5efc7d2c26c req-c2f112be-4450-40ad-9f19-7cbf4d891ac7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066839 Oct 28 12:35:39.077603 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 371/742] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:35:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:35:39.100503 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-7322c22f-6353-4555-96f7-36ae72eea2d8 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:39.103072 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-7322c22f-6353-4555-96f7-36ae72eea2d8 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: b81a4bfc-220f-4a70-b4a8-8da612c927fb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:39.109588 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-5d821174-5949-4f71-8d14-e906e7e782ef tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 26165 microversion: 2.20 time: 0.116244 Oct 28 12:35:39.110564 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 372/743] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:38 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 26165 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:35:39.117841 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7322c22f-6353-4555-96f7-36ae72eea2d8 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:39.118526 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7322c22f-6353-4555-96f7-36ae72eea2d8 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:39.119836 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7322c22f-6353-4555-96f7-36ae72eea2d8 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:39.120429 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7322c22f-6353-4555-96f7-36ae72eea2d8 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:39.355254 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-7322c22f-6353-4555-96f7-36ae72eea2d8 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:39.363660 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-7322c22f-6353-4555-96f7-36ae72eea2d8 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb" status: 200 len: 1266 microversion: 2.1 time: 0.267709 Oct 28 12:35:39.364451 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 372/744] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:39 2021] GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb => generated 1266 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:35:39.752356 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-88786827-ecd8-473b-ab8b-b6f5251a108e req-7b1ca7f2-7393-4182-81f7-1c006f5451b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d081053d-6631-45f9-b636-6967469f5a72", "name": "network-vif-deleted", "tag": "ac8f927f-20fb-4502-8417-782a383b150f"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:39.754175 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:35:39.754175 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:35:39.762527 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-88786827-ecd8-473b-ab8b-b6f5251a108e req-7b1ca7f2-7393-4182-81f7-1c006f5451b8 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:39.763133 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-88786827-ecd8-473b-ab8b-b6f5251a108e req-7b1ca7f2-7393-4182-81f7-1c006f5451b8 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:39.783956 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-88786827-ecd8-473b-ab8b-b6f5251a108e req-7b1ca7f2-7393-4182-81f7-1c006f5451b8 service nova] Creating event network-vif-deleted:ac8f927f-20fb-4502-8417-782a383b150f for instance d081053d-6631-45f9-b636-6967469f5a72 on hv-cinder-81514 Oct 28 12:35:39.789376 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-88786827-ecd8-473b-ab8b-b6f5251a108e req-7b1ca7f2-7393-4182-81f7-1c006f5451b8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040898 Oct 28 12:35:39.790200 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 373/745] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:35:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:35:39.902510 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-06304c09-c066-4b8f-a35f-a717cb114253 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:39.904473 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-06304c09-c066-4b8f-a35f-a717cb114253 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:39.912071 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-06304c09-c066-4b8f-a35f-a717cb114253 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:39.912924 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-06304c09-c066-4b8f-a35f-a717cb114253 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:39.913785 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-06304c09-c066-4b8f-a35f-a717cb114253 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:39.914287 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-06304c09-c066-4b8f-a35f-a717cb114253 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:39.915000 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-8ef6130a-a0db-4a94-ba48-7f884eb6c1f1 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:39.915959 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-8ef6130a-a0db-4a94-ba48-7f884eb6c1f1 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: d081053d-6631-45f9-b636-6967469f5a72] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:39.924969 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8ef6130a-a0db-4a94-ba48-7f884eb6c1f1 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:39.925928 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8ef6130a-a0db-4a94-ba48-7f884eb6c1f1 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:39.927048 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8ef6130a-a0db-4a94-ba48-7f884eb6c1f1 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:39.927792 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8ef6130a-a0db-4a94-ba48-7f884eb6c1f1 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:39.968107 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8ef6130a-a0db-4a94-ba48-7f884eb6c1f1 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:39.969103 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8ef6130a-a0db-4a94-ba48-7f884eb6c1f1 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:39.969845 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.objects.instance [None req-8ef6130a-a0db-4a94-ba48-7f884eb6c1f1 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lazy-loading 'fault' on Instance uuid d081053d-6631-45f9-b636-6967469f5a72 {{(pid=115876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:35:40.031165 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-8ef6130a-a0db-4a94-ba48-7f884eb6c1f1 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:40.040037 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-8ef6130a-a0db-4a94-ba48-7f884eb6c1f1 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72" status: 200 len: 1308 microversion: 2.1 time: 0.131435 Oct 28 12:35:40.040978 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 374/746] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:39 2021] GET /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72 => generated 1308 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:35:40.126998 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-9682d8ac-170d-40bb-999b-5df84faec6b0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:40.128478 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-9682d8ac-170d-40bb-999b-5df84faec6b0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:40.137000 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9682d8ac-170d-40bb-999b-5df84faec6b0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:40.137719 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9682d8ac-170d-40bb-999b-5df84faec6b0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:40.138462 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9682d8ac-170d-40bb-999b-5df84faec6b0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:40.139074 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9682d8ac-170d-40bb-999b-5df84faec6b0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:40.169804 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-06304c09-c066-4b8f-a35f-a717cb114253 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:40.182234 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-06304c09-c066-4b8f-a35f-a717cb114253 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638" status: 200 len: 1362 microversion: 2.1 time: 0.285020 Oct 28 12:35:40.190173 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 373/747] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:39 2021] GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638 => generated 1362 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:40.236148 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-9682d8ac-170d-40bb-999b-5df84faec6b0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 26990 microversion: 2.20 time: 0.110044 Oct 28 12:35:40.236148 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 375/748] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:40 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 26990 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:35:40.381324 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-1d0a832f-f20c-4555-8a1d-2bb0c7ce18ee tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:40.381812 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-1d0a832f-f20c-4555-8a1d-2bb0c7ce18ee tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: b81a4bfc-220f-4a70-b4a8-8da612c927fb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:40.388419 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1d0a832f-f20c-4555-8a1d-2bb0c7ce18ee tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:40.388954 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1d0a832f-f20c-4555-8a1d-2bb0c7ce18ee tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:40.390076 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1d0a832f-f20c-4555-8a1d-2bb0c7ce18ee tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:40.390501 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1d0a832f-f20c-4555-8a1d-2bb0c7ce18ee tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:40.537301 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-1d0a832f-f20c-4555-8a1d-2bb0c7ce18ee tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:40.544830 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-1d0a832f-f20c-4555-8a1d-2bb0c7ce18ee tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb" status: 200 len: 1266 microversion: 2.1 time: 0.167340 Oct 28 12:35:40.545396 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 374/749] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:40 2021] GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:35:41.058031 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-0b00bf2e-d850-4557-a3f9-8390cae93705 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:41.058688 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-0b00bf2e-d850-4557-a3f9-8390cae93705 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: d081053d-6631-45f9-b636-6967469f5a72] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:41.066021 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-0b00bf2e-d850-4557-a3f9-8390cae93705 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:41.066460 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-0b00bf2e-d850-4557-a3f9-8390cae93705 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:41.067230 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-0b00bf2e-d850-4557-a3f9-8390cae93705 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:41.067663 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-0b00bf2e-d850-4557-a3f9-8390cae93705 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:41.082110 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.wsgi [None req-0b00bf2e-d850-4557-a3f9-8390cae93705 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] HTTP exception thrown: Instance d081053d-6631-45f9-b636-6967469f5a72 could not be found. Oct 28 12:35:41.082692 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-0b00bf2e-d850-4557-a3f9-8390cae93705 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Returning 404 to user: Instance d081053d-6631-45f9-b636-6967469f5a72 could not be found. {{(pid=115876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:35:41.083513 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-0b00bf2e-d850-4557-a3f9-8390cae93705 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72" status: 404 len: 111 microversion: 2.1 time: 0.029913 Oct 28 12:35:41.084057 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 376/750] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:41 2021] GET /compute/v2.1/servers/d081053d-6631-45f9-b636-6967469f5a72 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:35:41.198932 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-804d1a2d-cfb4-4c27-8cf4-497f8d00c447 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:41.199529 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-804d1a2d-cfb4-4c27-8cf4-497f8d00c447 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:41.206000 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-804d1a2d-cfb4-4c27-8cf4-497f8d00c447 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:41.206420 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-804d1a2d-cfb4-4c27-8cf4-497f8d00c447 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:41.207218 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-804d1a2d-cfb4-4c27-8cf4-497f8d00c447 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:41.207648 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-804d1a2d-cfb4-4c27-8cf4-497f8d00c447 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:41.245703 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-1494507e-079b-49c5-9532-f7e575e3c9aa tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:41.247042 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-1494507e-079b-49c5-9532-f7e575e3c9aa tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:41.255137 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1494507e-079b-49c5-9532-f7e575e3c9aa tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:41.255712 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1494507e-079b-49c5-9532-f7e575e3c9aa tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:41.256456 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1494507e-079b-49c5-9532-f7e575e3c9aa tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:41.256907 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1494507e-079b-49c5-9532-f7e575e3c9aa tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:41.338724 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-1494507e-079b-49c5-9532-f7e575e3c9aa tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 27540 microversion: 2.20 time: 0.097928 Oct 28 12:35:41.339973 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 377/751] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:41 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 27540 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:35:41.348641 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-804d1a2d-cfb4-4c27-8cf4-497f8d00c447 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:41.360337 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-804d1a2d-cfb4-4c27-8cf4-497f8d00c447 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638" status: 200 len: 1362 microversion: 2.1 time: 0.165362 Oct 28 12:35:41.361445 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 375/752] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:41 2021] GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:41.562729 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-585ae02e-5efc-4013-b596-a6d373d80969 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:41.563531 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-585ae02e-5efc-4013-b596-a6d373d80969 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: b81a4bfc-220f-4a70-b4a8-8da612c927fb] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:41.571024 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-585ae02e-5efc-4013-b596-a6d373d80969 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:41.571442 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-585ae02e-5efc-4013-b596-a6d373d80969 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:41.572216 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-585ae02e-5efc-4013-b596-a6d373d80969 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:41.572635 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-585ae02e-5efc-4013-b596-a6d373d80969 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:41.706540 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-585ae02e-5efc-4013-b596-a6d373d80969 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:41.714661 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-585ae02e-5efc-4013-b596-a6d373d80969 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb" status: 200 len: 1266 microversion: 2.1 time: 0.156051 Oct 28 12:35:41.715211 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 378/753] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:41 2021] GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:42.215046 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-47a91085-0b79-42d3-a2e8-051e7743cb39 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:42.215535 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-47a91085-0b79-42d3-a2e8-051e7743cb39 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 9d962dac-e3a8-4f73-bc9e-bc11692b0250] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:42.222018 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-47a91085-0b79-42d3-a2e8-051e7743cb39 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:42.222462 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-47a91085-0b79-42d3-a2e8-051e7743cb39 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:42.223225 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-47a91085-0b79-42d3-a2e8-051e7743cb39 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:42.223655 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-47a91085-0b79-42d3-a2e8-051e7743cb39 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:42.250293 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-47a91085-0b79-42d3-a2e8-051e7743cb39 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 9d962dac-e3a8-4f73-bc9e-bc11692b0250] Going to try to terminate instance {{(pid=115877) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:35:42.329697 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-47a91085-0b79-42d3-a2e8-051e7743cb39 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "DELETE /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250" status: 204 len: 0 microversion: 2.1 time: 0.118336 Oct 28 12:35:42.330281 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 376/754] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Oct 28 12:35:42 2021] DELETE /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:35:42.340495 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-f2959a96-1f2b-4c23-a97b-cc540db97064 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:42.341295 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-f2959a96-1f2b-4c23-a97b-cc540db97064 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 9d962dac-e3a8-4f73-bc9e-bc11692b0250] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:42.347607 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f2959a96-1f2b-4c23-a97b-cc540db97064 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:42.348069 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f2959a96-1f2b-4c23-a97b-cc540db97064 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:42.348987 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f2959a96-1f2b-4c23-a97b-cc540db97064 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:42.349388 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f2959a96-1f2b-4c23-a97b-cc540db97064 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:42.352743 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-5b1c56e3-5c08-401e-bfeb-cad7f1da623e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:42.353924 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-5b1c56e3-5c08-401e-bfeb-cad7f1da623e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:42.360453 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5b1c56e3-5c08-401e-bfeb-cad7f1da623e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:42.360936 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5b1c56e3-5c08-401e-bfeb-cad7f1da623e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:42.361804 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5b1c56e3-5c08-401e-bfeb-cad7f1da623e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:42.362281 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5b1c56e3-5c08-401e-bfeb-cad7f1da623e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:42.443587 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-5b1c56e3-5c08-401e-bfeb-cad7f1da623e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 28004 microversion: 2.20 time: 0.095331 Oct 28 12:35:42.444946 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 377/755] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:42 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 28004 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:35:42.451989 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-9ebd0d99-ca97-477f-bacd-3e549e2f9011 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:42.452758 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-9ebd0d99-ca97-477f-bacd-3e549e2f9011 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:42.459551 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9ebd0d99-ca97-477f-bacd-3e549e2f9011 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:42.460026 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9ebd0d99-ca97-477f-bacd-3e549e2f9011 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:42.460821 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9ebd0d99-ca97-477f-bacd-3e549e2f9011 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:42.461227 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9ebd0d99-ca97-477f-bacd-3e549e2f9011 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:42.481625 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f2959a96-1f2b-4c23-a97b-cc540db97064 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:42.489409 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-f2959a96-1f2b-4c23-a97b-cc540db97064 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250" status: 200 len: 1513 microversion: 2.1 time: 0.154005 Oct 28 12:35:42.489965 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 379/756] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:42 2021] GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:42.584284 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-9ebd0d99-ca97-477f-bacd-3e549e2f9011 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:42.591601 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-9ebd0d99-ca97-477f-bacd-3e549e2f9011 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638" status: 200 len: 1362 microversion: 2.1 time: 0.145844 Oct 28 12:35:42.592138 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 378/757] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:42 2021] GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638 => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:42.731553 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-58ec439c-1c9a-478a-85b4-c30b7b7dcc3b tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:42.732163 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-58ec439c-1c9a-478a-85b4-c30b7b7dcc3b tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: b81a4bfc-220f-4a70-b4a8-8da612c927fb] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:42.738743 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-58ec439c-1c9a-478a-85b4-c30b7b7dcc3b tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:42.739204 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-58ec439c-1c9a-478a-85b4-c30b7b7dcc3b tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:42.739929 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-58ec439c-1c9a-478a-85b4-c30b7b7dcc3b tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:42.740362 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-58ec439c-1c9a-478a-85b4-c30b7b7dcc3b tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:42.873405 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-58ec439c-1c9a-478a-85b4-c30b7b7dcc3b tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:42.881038 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-58ec439c-1c9a-478a-85b4-c30b7b7dcc3b tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb" status: 200 len: 1266 microversion: 2.1 time: 0.153184 Oct 28 12:35:42.881619 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 380/758] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:42 2021] GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:43.455869 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-cf4f8aab-0956-4a77-8a4d-e5204176fa76 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:43.456840 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-cf4f8aab-0956-4a77-8a4d-e5204176fa76 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:43.463633 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-cf4f8aab-0956-4a77-8a4d-e5204176fa76 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:43.463854 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-cf4f8aab-0956-4a77-8a4d-e5204176fa76 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:43.465301 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-cf4f8aab-0956-4a77-8a4d-e5204176fa76 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:43.465886 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-cf4f8aab-0956-4a77-8a4d-e5204176fa76 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:43.510852 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-8d1529cf-1210-4e97-a5d5-9ae4487f2840 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:43.512246 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-8d1529cf-1210-4e97-a5d5-9ae4487f2840 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 9d962dac-e3a8-4f73-bc9e-bc11692b0250] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:43.519899 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8d1529cf-1210-4e97-a5d5-9ae4487f2840 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:43.522065 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8d1529cf-1210-4e97-a5d5-9ae4487f2840 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:43.522918 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8d1529cf-1210-4e97-a5d5-9ae4487f2840 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:43.523363 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8d1529cf-1210-4e97-a5d5-9ae4487f2840 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:43.567411 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-cf4f8aab-0956-4a77-8a4d-e5204176fa76 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 28191 microversion: 2.20 time: 0.114944 Oct 28 12:35:43.567875 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 379/759] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:43 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 28191 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:35:43.610151 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-5ee46d07-004c-43f7-bfe6-20e66f1958f1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:43.612385 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-5ee46d07-004c-43f7-bfe6-20e66f1958f1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:43.621503 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5ee46d07-004c-43f7-bfe6-20e66f1958f1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:43.621959 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5ee46d07-004c-43f7-bfe6-20e66f1958f1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:43.622736 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5ee46d07-004c-43f7-bfe6-20e66f1958f1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:43.623168 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5ee46d07-004c-43f7-bfe6-20e66f1958f1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:43.717358 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-8d1529cf-1210-4e97-a5d5-9ae4487f2840 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:43.724883 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-8d1529cf-1210-4e97-a5d5-9ae4487f2840 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250" status: 200 len: 1513 microversion: 2.1 time: 0.220896 Oct 28 12:35:43.725432 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 381/760] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:43 2021] GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250 => generated 1513 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:43.826739 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-5ee46d07-004c-43f7-bfe6-20e66f1958f1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:43.834697 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-5ee46d07-004c-43f7-bfe6-20e66f1958f1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638" status: 200 len: 1362 microversion: 2.1 time: 0.229964 Oct 28 12:35:43.835251 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 380/761] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:43 2021] GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638 => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:43.901321 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-cec52e88-1f2c-4b7d-b663-dfaa742f5b72 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:43.901917 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-cec52e88-1f2c-4b7d-b663-dfaa742f5b72 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: b81a4bfc-220f-4a70-b4a8-8da612c927fb] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:43.908293 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cec52e88-1f2c-4b7d-b663-dfaa742f5b72 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:43.908955 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cec52e88-1f2c-4b7d-b663-dfaa742f5b72 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:43.910051 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cec52e88-1f2c-4b7d-b663-dfaa742f5b72 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:43.910782 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cec52e88-1f2c-4b7d-b663-dfaa742f5b72 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:44.120274 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-cec52e88-1f2c-4b7d-b663-dfaa742f5b72 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:44.128361 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-cec52e88-1f2c-4b7d-b663-dfaa742f5b72 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb" status: 200 len: 1266 microversion: 2.1 time: 0.233412 Oct 28 12:35:44.129253 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 382/762] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:43 2021] GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:44.580081 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-7f191dee-b135-4074-924a-eaafd58c0429 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:44.581034 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-7f191dee-b135-4074-924a-eaafd58c0429 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:44.587993 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7f191dee-b135-4074-924a-eaafd58c0429 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:44.588475 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7f191dee-b135-4074-924a-eaafd58c0429 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:44.589291 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7f191dee-b135-4074-924a-eaafd58c0429 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:44.589724 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7f191dee-b135-4074-924a-eaafd58c0429 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:44.654460 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-7f191dee-b135-4074-924a-eaafd58c0429 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 28191 microversion: 2.20 time: 0.078175 Oct 28 12:35:44.655103 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 381/763] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:44 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 28191 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:35:44.703941 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-ba97e73b-0555-47a8-a875-e8fc2fc1dfb3 req-f523421a-7db3-4221-9ee7-9d34c6098c39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d962dac-e3a8-4f73-bc9e-bc11692b0250", "name": "network-vif-deleted", "tag": "666fa29b-3f69-4f77-ae13-5a61867d742b"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:44.709392 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:35:44.709392 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:35:44.718212 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-ba97e73b-0555-47a8-a875-e8fc2fc1dfb3 req-f523421a-7db3-4221-9ee7-9d34c6098c39 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:44.718728 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-ba97e73b-0555-47a8-a875-e8fc2fc1dfb3 req-f523421a-7db3-4221-9ee7-9d34c6098c39 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:44.731579 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-ba97e73b-0555-47a8-a875-e8fc2fc1dfb3 req-f523421a-7db3-4221-9ee7-9d34c6098c39 service nova] Creating event network-vif-deleted:666fa29b-3f69-4f77-ae13-5a61867d742b for instance 9d962dac-e3a8-4f73-bc9e-bc11692b0250 on hv-cinder-81514 Oct 28 12:35:44.741017 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-ba97e73b-0555-47a8-a875-e8fc2fc1dfb3 req-f523421a-7db3-4221-9ee7-9d34c6098c39 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040700 Oct 28 12:35:44.741710 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 383/764] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:35:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:35:44.749504 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-e2c70600-1ac7-4a33-8f9d-85fadbccecf0 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:44.750962 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-e2c70600-1ac7-4a33-8f9d-85fadbccecf0 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 9d962dac-e3a8-4f73-bc9e-bc11692b0250] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:44.763391 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e2c70600-1ac7-4a33-8f9d-85fadbccecf0 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:44.764511 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e2c70600-1ac7-4a33-8f9d-85fadbccecf0 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:44.766235 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e2c70600-1ac7-4a33-8f9d-85fadbccecf0 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:44.767208 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e2c70600-1ac7-4a33-8f9d-85fadbccecf0 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:44.853463 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-35d338e4-26e9-4a8d-a44a-5169c8032988 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:44.854485 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-35d338e4-26e9-4a8d-a44a-5169c8032988 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:44.855628 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-e2c70600-1ac7-4a33-8f9d-85fadbccecf0 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:44.862224 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-35d338e4-26e9-4a8d-a44a-5169c8032988 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:44.863083 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-35d338e4-26e9-4a8d-a44a-5169c8032988 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:44.863850 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-e2c70600-1ac7-4a33-8f9d-85fadbccecf0 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250" status: 200 len: 1303 microversion: 2.1 time: 0.124485 Oct 28 12:35:44.864858 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 382/765] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:44 2021] GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250 => generated 1303 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:44.865190 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-35d338e4-26e9-4a8d-a44a-5169c8032988 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:44.865811 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-35d338e4-26e9-4a8d-a44a-5169c8032988 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:44.935683 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-909f864a-21d1-426f-8b2c-1476b26e51df req-c06f5408-2f29-4bfb-9182-0c4555bc19c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3173757b-e9bd-478b-93ee-55b43fa30638", "name": "network-vif-plugged", "status": "completed", "tag": "07d4f5a8-2fdd-4368-8fd4-1b5d39b142a1"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:44.937382 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:35:44.937382 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:35:44.944953 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-909f864a-21d1-426f-8b2c-1476b26e51df req-c06f5408-2f29-4bfb-9182-0c4555bc19c1 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:44.945480 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-909f864a-21d1-426f-8b2c-1476b26e51df req-c06f5408-2f29-4bfb-9182-0c4555bc19c1 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:44.958819 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-909f864a-21d1-426f-8b2c-1476b26e51df req-c06f5408-2f29-4bfb-9182-0c4555bc19c1 service nova] Creating event network-vif-plugged:07d4f5a8-2fdd-4368-8fd4-1b5d39b142a1 for instance 3173757b-e9bd-478b-93ee-55b43fa30638 on hv-cinder-81514 Oct 28 12:35:44.965364 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-909f864a-21d1-426f-8b2c-1476b26e51df req-c06f5408-2f29-4bfb-9182-0c4555bc19c1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033281 Oct 28 12:35:44.966260 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 383/766] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:35:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:35:45.006083 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-35d338e4-26e9-4a8d-a44a-5169c8032988 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:45.014770 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-35d338e4-26e9-4a8d-a44a-5169c8032988 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638" status: 200 len: 1362 microversion: 2.1 time: 0.166488 Oct 28 12:35:45.015693 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 384/767] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:44 2021] GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:35:45.157660 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-65de26de-03e7-4e88-a896-433d186ab20c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:45.158443 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-65de26de-03e7-4e88-a896-433d186ab20c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: b81a4bfc-220f-4a70-b4a8-8da612c927fb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:45.165588 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-65de26de-03e7-4e88-a896-433d186ab20c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:45.166111 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-65de26de-03e7-4e88-a896-433d186ab20c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:45.167138 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-65de26de-03e7-4e88-a896-433d186ab20c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:45.167568 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-65de26de-03e7-4e88-a896-433d186ab20c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:45.299878 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-65de26de-03e7-4e88-a896-433d186ab20c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:45.307886 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-65de26de-03e7-4e88-a896-433d186ab20c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb" status: 200 len: 1266 microversion: 2.1 time: 0.165217 Oct 28 12:35:45.308464 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 384/768] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:45 2021] GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:45.668100 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-6deff335-d303-4196-8bf5-d33501560681 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:45.669169 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-6deff335-d303-4196-8bf5-d33501560681 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:45.675960 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6deff335-d303-4196-8bf5-d33501560681 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:45.676402 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6deff335-d303-4196-8bf5-d33501560681 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:45.677199 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6deff335-d303-4196-8bf5-d33501560681 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:45.677628 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6deff335-d303-4196-8bf5-d33501560681 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:45.751065 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-6deff335-d303-4196-8bf5-d33501560681 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 28482 microversion: 2.20 time: 0.087237 Oct 28 12:35:45.751866 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 385/769] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:45 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 28482 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:35:45.879840 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-f3bb5a8e-6d74-4174-9390-e331c1530b1a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:45.880464 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-f3bb5a8e-6d74-4174-9390-e331c1530b1a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 9d962dac-e3a8-4f73-bc9e-bc11692b0250] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:45.887456 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f3bb5a8e-6d74-4174-9390-e331c1530b1a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:45.887965 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f3bb5a8e-6d74-4174-9390-e331c1530b1a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:45.888830 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f3bb5a8e-6d74-4174-9390-e331c1530b1a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:45.889249 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f3bb5a8e-6d74-4174-9390-e331c1530b1a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:45.904824 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.wsgi [None req-f3bb5a8e-6d74-4174-9390-e331c1530b1a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] HTTP exception thrown: Instance 9d962dac-e3a8-4f73-bc9e-bc11692b0250 could not be found. Oct 28 12:35:45.905620 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-f3bb5a8e-6d74-4174-9390-e331c1530b1a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Returning 404 to user: Instance 9d962dac-e3a8-4f73-bc9e-bc11692b0250 could not be found. {{(pid=115877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:35:45.906846 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-f3bb5a8e-6d74-4174-9390-e331c1530b1a tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250" status: 404 len: 111 microversion: 2.1 time: 0.030839 Oct 28 12:35:45.907540 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 385/770] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:45 2021] GET /compute/v2.1/servers/9d962dac-e3a8-4f73-bc9e-bc11692b0250 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:35:45.916123 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-e789e385-40de-4980-9121-634d2f219f77 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:45.916696 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-e789e385-40de-4980-9121-634d2f219f77 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 251e6078-cf22-4b27-b53f-103c7a27e690] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:45.924180 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e789e385-40de-4980-9121-634d2f219f77 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:45.924541 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e789e385-40de-4980-9121-634d2f219f77 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:45.925333 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e789e385-40de-4980-9121-634d2f219f77 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:45.925757 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e789e385-40de-4980-9121-634d2f219f77 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:45.951227 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-e789e385-40de-4980-9121-634d2f219f77 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 251e6078-cf22-4b27-b53f-103c7a27e690] Going to try to terminate instance {{(pid=115876) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:35:46.028783 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-e789e385-40de-4980-9121-634d2f219f77 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "DELETE /compute/v2.1/servers/251e6078-cf22-4b27-b53f-103c7a27e690" status: 204 len: 0 microversion: 2.1 time: 0.116432 Oct 28 12:35:46.029303 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 386/771] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Oct 28 12:35:45 2021] DELETE /compute/v2.1/servers/251e6078-cf22-4b27-b53f-103c7a27e690 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:35:46.038474 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-4a49fa3e-c3bc-4fcf-a1c6-04874ad48be0 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:46.039142 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-267f7bdf-4eeb-44ad-b040-cd5258b8e081 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:46.039364 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-4a49fa3e-c3bc-4fcf-a1c6-04874ad48be0 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 251e6078-cf22-4b27-b53f-103c7a27e690] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:46.039749 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-267f7bdf-4eeb-44ad-b040-cd5258b8e081 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:46.045919 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4a49fa3e-c3bc-4fcf-a1c6-04874ad48be0 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:46.046114 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-267f7bdf-4eeb-44ad-b040-cd5258b8e081 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:46.046443 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4a49fa3e-c3bc-4fcf-a1c6-04874ad48be0 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:46.046737 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-267f7bdf-4eeb-44ad-b040-cd5258b8e081 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:46.047339 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4a49fa3e-c3bc-4fcf-a1c6-04874ad48be0 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:46.047465 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-267f7bdf-4eeb-44ad-b040-cd5258b8e081 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:46.047822 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4a49fa3e-c3bc-4fcf-a1c6-04874ad48be0 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:46.048191 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-267f7bdf-4eeb-44ad-b040-cd5258b8e081 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:46.250796 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-4a49fa3e-c3bc-4fcf-a1c6-04874ad48be0 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:46.257057 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-267f7bdf-4eeb-44ad-b040-cd5258b8e081 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:46.262495 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-4a49fa3e-c3bc-4fcf-a1c6-04874ad48be0 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/251e6078-cf22-4b27-b53f-103c7a27e690" status: 200 len: 1514 microversion: 2.1 time: 0.228196 Oct 28 12:35:46.262495 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 387/772] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:46 2021] GET /compute/v2.1/servers/251e6078-cf22-4b27-b53f-103c7a27e690 => generated 1514 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:46.265896 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-267f7bdf-4eeb-44ad-b040-cd5258b8e081 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638" status: 200 len: 1362 microversion: 2.1 time: 0.230425 Oct 28 12:35:46.266559 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 386/773] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:46 2021] GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638 => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:46.324980 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-a874a000-271a-40d4-812b-05625165b426 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:46.325580 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-a874a000-271a-40d4-812b-05625165b426 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: b81a4bfc-220f-4a70-b4a8-8da612c927fb] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:46.331983 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a874a000-271a-40d4-812b-05625165b426 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:46.332418 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a874a000-271a-40d4-812b-05625165b426 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:46.333212 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a874a000-271a-40d4-812b-05625165b426 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:46.333697 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a874a000-271a-40d4-812b-05625165b426 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:46.468511 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-a874a000-271a-40d4-812b-05625165b426 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:46.477231 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-a874a000-271a-40d4-812b-05625165b426 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb" status: 200 len: 1266 microversion: 2.1 time: 0.155896 Oct 28 12:35:46.477844 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 388/774] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:46 2021] GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:46.763829 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-0ab507c1-983f-4eab-965a-6f4e9be479e9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:46.764756 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-0ab507c1-983f-4eab-965a-6f4e9be479e9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:46.773775 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0ab507c1-983f-4eab-965a-6f4e9be479e9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:46.774236 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0ab507c1-983f-4eab-965a-6f4e9be479e9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:46.775050 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0ab507c1-983f-4eab-965a-6f4e9be479e9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:46.775562 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0ab507c1-983f-4eab-965a-6f4e9be479e9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:46.855464 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-0ab507c1-983f-4eab-965a-6f4e9be479e9 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 28650 microversion: 2.20 time: 0.095250 Oct 28 12:35:46.856115 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 387/775] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:46 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 28650 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:35:46.987104 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-f52ab95d-d6b1-4cd4-aef9-3db8722e49b4 req-24afe4c9-1472-4117-8262-2ef2f785f388 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b81a4bfc-220f-4a70-b4a8-8da612c927fb", "name": "network-vif-plugged", "status": "completed", "tag": "a302007e-59e1-42c9-9b5a-9b428e8140c9"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:46.989777 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:35:46.989777 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:35:47.000010 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-f52ab95d-d6b1-4cd4-aef9-3db8722e49b4 req-24afe4c9-1472-4117-8262-2ef2f785f388 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:47.000681 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-f52ab95d-d6b1-4cd4-aef9-3db8722e49b4 req-24afe4c9-1472-4117-8262-2ef2f785f388 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:47.019006 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-f52ab95d-d6b1-4cd4-aef9-3db8722e49b4 req-24afe4c9-1472-4117-8262-2ef2f785f388 service nova] Creating event network-vif-plugged:a302007e-59e1-42c9-9b5a-9b428e8140c9 for instance b81a4bfc-220f-4a70-b4a8-8da612c927fb on hv-cinder-81514 Oct 28 12:35:47.025427 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-f52ab95d-d6b1-4cd4-aef9-3db8722e49b4 req-24afe4c9-1472-4117-8262-2ef2f785f388 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044638 Oct 28 12:35:47.026262 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 389/776] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:35:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:35:47.279954 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-a31fcc94-53ab-4936-bab2-4407cab1f463 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:47.280875 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-a31fcc94-53ab-4936-bab2-4407cab1f463 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 251e6078-cf22-4b27-b53f-103c7a27e690] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:47.283872 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-e450e34c-2619-4b1c-b3d9-da529b416356 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:47.284867 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-e450e34c-2619-4b1c-b3d9-da529b416356 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:47.288627 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a31fcc94-53ab-4936-bab2-4407cab1f463 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:47.289118 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a31fcc94-53ab-4936-bab2-4407cab1f463 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:47.289887 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a31fcc94-53ab-4936-bab2-4407cab1f463 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:47.290361 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a31fcc94-53ab-4936-bab2-4407cab1f463 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:47.291747 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e450e34c-2619-4b1c-b3d9-da529b416356 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:47.292298 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e450e34c-2619-4b1c-b3d9-da529b416356 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:47.293181 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e450e34c-2619-4b1c-b3d9-da529b416356 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:47.293712 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e450e34c-2619-4b1c-b3d9-da529b416356 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:47.467278 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-a31fcc94-53ab-4936-bab2-4407cab1f463 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:47.472036 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-e450e34c-2619-4b1c-b3d9-da529b416356 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:47.475576 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-a31fcc94-53ab-4936-bab2-4407cab1f463 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/251e6078-cf22-4b27-b53f-103c7a27e690" status: 200 len: 1514 microversion: 2.1 time: 0.199759 Oct 28 12:35:47.476171 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 388/777] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:47 2021] GET /compute/v2.1/servers/251e6078-cf22-4b27-b53f-103c7a27e690 => generated 1514 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:47.480595 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-e450e34c-2619-4b1c-b3d9-da529b416356 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638" status: 200 len: 1548 microversion: 2.1 time: 0.201003 Oct 28 12:35:47.481274 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 390/778] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:47 2021] GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638 => generated 1548 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:47.497481 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-af13bef3-4678-4b39-85a1-5146242bcd20 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:47.497929 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-cec0b3a5-e6c0-4435-84db-1cb3937fb6e1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:47.498273 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-af13bef3-4678-4b39-85a1-5146242bcd20 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: b81a4bfc-220f-4a70-b4a8-8da612c927fb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:47.498389 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-cec0b3a5-e6c0-4435-84db-1cb3937fb6e1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:47.505132 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cec0b3a5-e6c0-4435-84db-1cb3937fb6e1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:47.505566 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cec0b3a5-e6c0-4435-84db-1cb3937fb6e1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:47.505696 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-af13bef3-4678-4b39-85a1-5146242bcd20 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:47.506183 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-af13bef3-4678-4b39-85a1-5146242bcd20 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:47.506349 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cec0b3a5-e6c0-4435-84db-1cb3937fb6e1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:47.506750 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cec0b3a5-e6c0-4435-84db-1cb3937fb6e1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:47.507448 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-af13bef3-4678-4b39-85a1-5146242bcd20 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:47.507963 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-af13bef3-4678-4b39-85a1-5146242bcd20 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:47.624501 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-cec0b3a5-e6c0-4435-84db-1cb3937fb6e1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.130096 Oct 28 12:35:47.625212 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 391/779] 10.222.0.62 () {58 vars in 1274 bytes} [Thu Oct 28 12:35:47 2021] GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:35:47.679273 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-af13bef3-4678-4b39-85a1-5146242bcd20 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:47.686963 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-af13bef3-4678-4b39-85a1-5146242bcd20 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb" status: 200 len: 1266 microversion: 2.1 time: 0.193669 Oct 28 12:35:47.687561 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 389/780] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:47 2021] GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:47.868154 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-53dd9ddb-151c-49f3-9df6-f84d3c9b4ac4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:47.869313 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-53dd9ddb-151c-49f3-9df6-f84d3c9b4ac4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:47.876263 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-53dd9ddb-151c-49f3-9df6-f84d3c9b4ac4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:47.876617 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-53dd9ddb-151c-49f3-9df6-f84d3c9b4ac4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:47.877432 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-53dd9ddb-151c-49f3-9df6-f84d3c9b4ac4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:47.877853 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-53dd9ddb-151c-49f3-9df6-f84d3c9b4ac4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:47.946084 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-53dd9ddb-151c-49f3-9df6-f84d3c9b4ac4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 28650 microversion: 2.20 time: 0.081417 Oct 28 12:35:47.946766 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 392/781] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:47 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 28650 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:35:48.492807 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-b0512ca8-2978-4171-a8f0-85ed0c925caf tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:48.493431 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-b0512ca8-2978-4171-a8f0-85ed0c925caf tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 251e6078-cf22-4b27-b53f-103c7a27e690] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:48.499957 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b0512ca8-2978-4171-a8f0-85ed0c925caf tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:48.500393 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b0512ca8-2978-4171-a8f0-85ed0c925caf tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:48.501196 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b0512ca8-2978-4171-a8f0-85ed0c925caf tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:48.501615 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b0512ca8-2978-4171-a8f0-85ed0c925caf tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:48.646680 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-b0512ca8-2978-4171-a8f0-85ed0c925caf tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:48.654620 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-b0512ca8-2978-4171-a8f0-85ed0c925caf tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/251e6078-cf22-4b27-b53f-103c7a27e690" status: 200 len: 1514 microversion: 2.1 time: 0.165924 Oct 28 12:35:48.659776 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 390/782] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:48 2021] GET /compute/v2.1/servers/251e6078-cf22-4b27-b53f-103c7a27e690 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:48.703892 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-5b421af1-8dcd-4563-a646-46f9d98de519 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:48.705403 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-5b421af1-8dcd-4563-a646-46f9d98de519 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: b81a4bfc-220f-4a70-b4a8-8da612c927fb] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:48.712327 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5b421af1-8dcd-4563-a646-46f9d98de519 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:48.713105 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5b421af1-8dcd-4563-a646-46f9d98de519 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:48.714063 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5b421af1-8dcd-4563-a646-46f9d98de519 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:48.714483 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5b421af1-8dcd-4563-a646-46f9d98de519 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:48.755469 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-19065121-30ce-4884-b6c5-d3301656ef44 req-618f12cc-3a71-4225-b813-aa29dcbfea9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "251e6078-cf22-4b27-b53f-103c7a27e690", "name": "network-vif-deleted", "tag": "bdba618a-d033-41e3-9405-ac2e006dac09"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:48.758079 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:35:48.758079 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:35:48.775374 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-19065121-30ce-4884-b6c5-d3301656ef44 req-618f12cc-3a71-4225-b813-aa29dcbfea9c service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:48.775878 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-19065121-30ce-4884-b6c5-d3301656ef44 req-618f12cc-3a71-4225-b813-aa29dcbfea9c service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:48.788237 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-19065121-30ce-4884-b6c5-d3301656ef44 req-618f12cc-3a71-4225-b813-aa29dcbfea9c service nova] Creating event network-vif-deleted:bdba618a-d033-41e3-9405-ac2e006dac09 for instance 251e6078-cf22-4b27-b53f-103c7a27e690 on hv-cinder-81514 Oct 28 12:35:48.796493 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-19065121-30ce-4884-b6c5-d3301656ef44 req-618f12cc-3a71-4225-b813-aa29dcbfea9c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046173 Oct 28 12:35:48.797524 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 391/783] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:35:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:35:48.897249 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-5b421af1-8dcd-4563-a646-46f9d98de519 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:48.905031 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-5b421af1-8dcd-4563-a646-46f9d98de519 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb" status: 200 len: 1452 microversion: 2.1 time: 0.204992 Oct 28 12:35:48.905624 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 393/784] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:48 2021] GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb => generated 1452 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:48.921713 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-ea11bc64-4536-4549-983a-d83d50ce698c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:48.922398 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-ea11bc64-4536-4549-983a-d83d50ce698c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: b81a4bfc-220f-4a70-b4a8-8da612c927fb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:48.928674 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ea11bc64-4536-4549-983a-d83d50ce698c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:48.929506 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ea11bc64-4536-4549-983a-d83d50ce698c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:48.930277 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ea11bc64-4536-4549-983a-d83d50ce698c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:48.930711 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ea11bc64-4536-4549-983a-d83d50ce698c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:48.959214 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-7d6f3b32-00c6-41bc-a9c5-1ce3c0756e8d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:48.960312 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-7d6f3b32-00c6-41bc-a9c5-1ce3c0756e8d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:48.966952 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7d6f3b32-00c6-41bc-a9c5-1ce3c0756e8d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:48.967393 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7d6f3b32-00c6-41bc-a9c5-1ce3c0756e8d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:48.968198 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7d6f3b32-00c6-41bc-a9c5-1ce3c0756e8d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:48.968578 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7d6f3b32-00c6-41bc-a9c5-1ce3c0756e8d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:49.051602 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-7d6f3b32-00c6-41bc-a9c5-1ce3c0756e8d tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 28650 microversion: 2.20 time: 0.096455 Oct 28 12:35:49.058030 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 394/785] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:48 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 28650 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:35:49.093757 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-ea11bc64-4536-4549-983a-d83d50ce698c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:49.101698 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-ea11bc64-4536-4549-983a-d83d50ce698c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb" status: 200 len: 1452 microversion: 2.1 time: 0.183937 Oct 28 12:35:49.102886 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 392/786] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:48 2021] GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb => generated 1452 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:35:49.240225 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-08c86927-bda6-4f7c-a081-c6eea101ad9d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:49.241097 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-08c86927-bda6-4f7c-a081-c6eea101ad9d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:49.248294 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-08c86927-bda6-4f7c-a081-c6eea101ad9d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:49.249072 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-08c86927-bda6-4f7c-a081-c6eea101ad9d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:49.250052 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-08c86927-bda6-4f7c-a081-c6eea101ad9d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:49.250661 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-08c86927-bda6-4f7c-a081-c6eea101ad9d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:49.317174 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-08c86927-bda6-4f7c-a081-c6eea101ad9d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 14 microversion: 2.1 time: 0.080922 Oct 28 12:35:49.318863 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 395/787] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:35:49 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:35:49.676218 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-3f5f0bb0-c60c-4fc3-8f96-911e8aeca9d8 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:49.677833 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-3f5f0bb0-c60c-4fc3-8f96-911e8aeca9d8 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: 251e6078-cf22-4b27-b53f-103c7a27e690] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:49.688234 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3f5f0bb0-c60c-4fc3-8f96-911e8aeca9d8 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:49.688977 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3f5f0bb0-c60c-4fc3-8f96-911e8aeca9d8 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:49.689908 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3f5f0bb0-c60c-4fc3-8f96-911e8aeca9d8 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:49.690561 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3f5f0bb0-c60c-4fc3-8f96-911e8aeca9d8 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:49.706219 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.wsgi [None req-3f5f0bb0-c60c-4fc3-8f96-911e8aeca9d8 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] HTTP exception thrown: Instance 251e6078-cf22-4b27-b53f-103c7a27e690 could not be found. Oct 28 12:35:49.707185 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-3f5f0bb0-c60c-4fc3-8f96-911e8aeca9d8 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Returning 404 to user: Instance 251e6078-cf22-4b27-b53f-103c7a27e690 could not be found. {{(pid=115877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:35:49.708102 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-3f5f0bb0-c60c-4fc3-8f96-911e8aeca9d8 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/251e6078-cf22-4b27-b53f-103c7a27e690" status: 404 len: 111 microversion: 2.1 time: 0.035758 Oct 28 12:35:49.708872 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 393/788] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:49 2021] GET /compute/v2.1/servers/251e6078-cf22-4b27-b53f-103c7a27e690 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:35:50.066512 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-2f7c6b8b-70cb-48fb-90b1-d30a819837e8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:50.067696 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-2f7c6b8b-70cb-48fb-90b1-d30a819837e8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:50.075140 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2f7c6b8b-70cb-48fb-90b1-d30a819837e8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:50.075635 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2f7c6b8b-70cb-48fb-90b1-d30a819837e8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:50.076492 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2f7c6b8b-70cb-48fb-90b1-d30a819837e8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:50.077046 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2f7c6b8b-70cb-48fb-90b1-d30a819837e8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:50.145532 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-2f7c6b8b-70cb-48fb-90b1-d30a819837e8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 28650 microversion: 2.20 time: 0.083053 Oct 28 12:35:50.146524 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 396/789] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:50 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 28650 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:35:50.327826 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-c08382af-3644-42c7-89f9-fb9d5bae96f3 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:50.328651 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-c08382af-3644-42c7-89f9-fb9d5bae96f3 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:50.335138 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c08382af-3644-42c7-89f9-fb9d5bae96f3 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:50.335705 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c08382af-3644-42c7-89f9-fb9d5bae96f3 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:50.336513 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c08382af-3644-42c7-89f9-fb9d5bae96f3 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:50.336940 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c08382af-3644-42c7-89f9-fb9d5bae96f3 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:50.401412 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-c08382af-3644-42c7-89f9-fb9d5bae96f3 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 14 microversion: 2.1 time: 0.077224 Oct 28 12:35:50.402050 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 394/790] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:35:50 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:35:50.817858 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-4957dc28-8959-49a3-82aa-1e4f3fc482ed req-ed3b7341-c277-4a89-8ea7-63dc7eba8bff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3173757b-e9bd-478b-93ee-55b43fa30638", "tag": "07d4f5a8-2fdd-4368-8fd4-1b5d39b142a1"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:50.820340 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:35:50.820340 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:35:50.829953 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-4957dc28-8959-49a3-82aa-1e4f3fc482ed req-ed3b7341-c277-4a89-8ea7-63dc7eba8bff service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:50.830674 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-4957dc28-8959-49a3-82aa-1e4f3fc482ed req-ed3b7341-c277-4a89-8ea7-63dc7eba8bff service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:50.843552 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-4957dc28-8959-49a3-82aa-1e4f3fc482ed req-ed3b7341-c277-4a89-8ea7-63dc7eba8bff service nova] Creating event network-changed:07d4f5a8-2fdd-4368-8fd4-1b5d39b142a1 for instance 3173757b-e9bd-478b-93ee-55b43fa30638 on hv-cinder-81514 Oct 28 12:35:50.850622 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-4957dc28-8959-49a3-82aa-1e4f3fc482ed req-ed3b7341-c277-4a89-8ea7-63dc7eba8bff service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038576 Oct 28 12:35:50.854419 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 397/791] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:35:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:35:50.866750 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-9a99b1b2-d5ae-4432-bd00-e55237f31dba tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:50.868353 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-9a99b1b2-d5ae-4432-bd00-e55237f31dba tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: c8647488-6b19-46a6-a95e-7280a2f63c58] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:50.880811 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9a99b1b2-d5ae-4432-bd00-e55237f31dba tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:50.881949 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9a99b1b2-d5ae-4432-bd00-e55237f31dba tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:50.883305 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9a99b1b2-d5ae-4432-bd00-e55237f31dba tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:50.884086 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9a99b1b2-d5ae-4432-bd00-e55237f31dba tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:50.925883 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-9a99b1b2-d5ae-4432-bd00-e55237f31dba tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: c8647488-6b19-46a6-a95e-7280a2f63c58] Going to try to terminate instance {{(pid=115877) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:35:51.006764 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-9a99b1b2-d5ae-4432-bd00-e55237f31dba tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58" status: 204 len: 0 microversion: 2.1 time: 0.150089 Oct 28 12:35:51.007423 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 395/792] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Oct 28 12:35:50 2021] DELETE /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:35:51.015852 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-ae322826-dd23-459e-be76-b8e9ddbea594 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:51.016555 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-ae322826-dd23-459e-be76-b8e9ddbea594 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: c8647488-6b19-46a6-a95e-7280a2f63c58] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:51.023621 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ae322826-dd23-459e-be76-b8e9ddbea594 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:51.024069 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ae322826-dd23-459e-be76-b8e9ddbea594 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:51.024906 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ae322826-dd23-459e-be76-b8e9ddbea594 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:51.025382 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ae322826-dd23-459e-be76-b8e9ddbea594 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:51.161502 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-615a3f6b-d043-4962-896d-6812317f8654 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:51.162512 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-615a3f6b-d043-4962-896d-6812317f8654 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:51.169648 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-615a3f6b-d043-4962-896d-6812317f8654 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:51.170287 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-615a3f6b-d043-4962-896d-6812317f8654 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:51.171237 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-615a3f6b-d043-4962-896d-6812317f8654 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:51.171821 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-615a3f6b-d043-4962-896d-6812317f8654 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:51.241311 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-ae322826-dd23-459e-be76-b8e9ddbea594 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:51.261440 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-ae322826-dd23-459e-be76-b8e9ddbea594 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58" status: 200 len: 1512 microversion: 2.1 time: 0.237907 Oct 28 12:35:51.261440 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 398/793] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:51 2021] GET /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58 => generated 1512 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:51.261440 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-ba85e774-89ea-44c9-9890-02bbd4d0cc3d req-2600c593-fff1-4a98-b4cb-ff3f733c50c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b81a4bfc-220f-4a70-b4a8-8da612c927fb", "tag": "a302007e-59e1-42c9-9b5a-9b428e8140c9"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:51.261440 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:35:51.261440 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:35:51.267635 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-615a3f6b-d043-4962-896d-6812317f8654 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 29019 microversion: 2.20 time: 0.111964 Oct 28 12:35:51.269055 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 396/794] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:51 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 29019 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:35:51.270284 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-ba85e774-89ea-44c9-9890-02bbd4d0cc3d req-2600c593-fff1-4a98-b4cb-ff3f733c50c9 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:51.270431 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-ba85e774-89ea-44c9-9890-02bbd4d0cc3d req-2600c593-fff1-4a98-b4cb-ff3f733c50c9 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:51.283080 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-ba85e774-89ea-44c9-9890-02bbd4d0cc3d req-2600c593-fff1-4a98-b4cb-ff3f733c50c9 service nova] Creating event network-changed:a302007e-59e1-42c9-9b5a-9b428e8140c9 for instance b81a4bfc-220f-4a70-b4a8-8da612c927fb on hv-cinder-81514 Oct 28 12:35:51.289075 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-ba85e774-89ea-44c9-9890-02bbd4d0cc3d req-2600c593-fff1-4a98-b4cb-ff3f733c50c9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034816 Oct 28 12:35:51.290276 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 399/795] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:35:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:35:51.414953 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-21bfae05-f5c9-4fb7-bd9f-57d73f730398 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:51.416144 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-21bfae05-f5c9-4fb7-bd9f-57d73f730398 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:51.423225 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-21bfae05-f5c9-4fb7-bd9f-57d73f730398 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:51.423673 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-21bfae05-f5c9-4fb7-bd9f-57d73f730398 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:51.424468 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-21bfae05-f5c9-4fb7-bd9f-57d73f730398 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:51.425736 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-21bfae05-f5c9-4fb7-bd9f-57d73f730398 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:51.494665 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-21bfae05-f5c9-4fb7-bd9f-57d73f730398 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 14 microversion: 2.1 time: 0.084296 Oct 28 12:35:51.496091 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 397/796] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:35:51 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:35:52.268960 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-012e77a8-c101-40f5-913b-af197603806b tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:52.269808 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-012e77a8-c101-40f5-913b-af197603806b tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: c8647488-6b19-46a6-a95e-7280a2f63c58] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:52.277632 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-012e77a8-c101-40f5-913b-af197603806b tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:52.278064 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-012e77a8-c101-40f5-913b-af197603806b tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:52.278885 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-012e77a8-c101-40f5-913b-af197603806b tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:52.279236 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-012e77a8-c101-40f5-913b-af197603806b tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:52.281629 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-a079b25b-94de-461c-9747-f4b4a5cd5fb7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:52.283412 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-a079b25b-94de-461c-9747-f4b4a5cd5fb7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:52.291720 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a079b25b-94de-461c-9747-f4b4a5cd5fb7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:52.292646 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a079b25b-94de-461c-9747-f4b4a5cd5fb7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:52.293661 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a079b25b-94de-461c-9747-f4b4a5cd5fb7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:52.294111 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a079b25b-94de-461c-9747-f4b4a5cd5fb7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:52.384376 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-a079b25b-94de-461c-9747-f4b4a5cd5fb7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 30772 microversion: 2.20 time: 0.107800 Oct 28 12:35:52.385086 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 398/797] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:52 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 30772 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:35:52.422274 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-012e77a8-c101-40f5-913b-af197603806b tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:52.430714 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-012e77a8-c101-40f5-913b-af197603806b tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58" status: 200 len: 1512 microversion: 2.1 time: 0.166645 Oct 28 12:35:52.431320 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 400/798] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:52 2021] GET /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58 => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:52.506641 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-75f09b4e-7baa-46fd-b130-93af75c265ea tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:52.507668 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-75f09b4e-7baa-46fd-b130-93af75c265ea tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:52.515046 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-75f09b4e-7baa-46fd-b130-93af75c265ea tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:52.515487 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-75f09b4e-7baa-46fd-b130-93af75c265ea tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:52.516265 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-75f09b4e-7baa-46fd-b130-93af75c265ea tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:52.516844 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-75f09b4e-7baa-46fd-b130-93af75c265ea tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:52.592502 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-75f09b4e-7baa-46fd-b130-93af75c265ea tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 14 microversion: 2.1 time: 0.089672 Oct 28 12:35:52.593187 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 399/799] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:35:52 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:35:53.396763 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-759b470b-2d83-4fdb-9340-a1f7daa65418 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:53.397744 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-759b470b-2d83-4fdb-9340-a1f7daa65418 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:53.408000 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-759b470b-2d83-4fdb-9340-a1f7daa65418 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:53.408576 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-759b470b-2d83-4fdb-9340-a1f7daa65418 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:53.409663 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-759b470b-2d83-4fdb-9340-a1f7daa65418 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:53.409663 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-759b470b-2d83-4fdb-9340-a1f7daa65418 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:53.478931 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-ec121353-ac1e-450f-adde-d271dedd13de req-3a7a69d1-bbfb-4075-8b8a-216b034fe2d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8647488-6b19-46a6-a95e-7280a2f63c58", "name": "network-vif-deleted", "tag": "7ce9b0c6-a42a-4be7-bfa3-19f0694292ee"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:53.481447 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:35:53.481447 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:35:53.490435 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-ec121353-ac1e-450f-adde-d271dedd13de req-3a7a69d1-bbfb-4075-8b8a-216b034fe2d6 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:53.490733 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-ec121353-ac1e-450f-adde-d271dedd13de req-3a7a69d1-bbfb-4075-8b8a-216b034fe2d6 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:53.494292 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-759b470b-2d83-4fdb-9340-a1f7daa65418 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 32591 microversion: 2.20 time: 0.102175 Oct 28 12:35:53.495424 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 401/800] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:53 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 32591 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:35:53.500706 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-8f99b522-0ff7-4edd-ad63-192b84f6f861 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:53.501413 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-8f99b522-0ff7-4edd-ad63-192b84f6f861 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: c8647488-6b19-46a6-a95e-7280a2f63c58] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:53.505663 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-ec121353-ac1e-450f-adde-d271dedd13de req-3a7a69d1-bbfb-4075-8b8a-216b034fe2d6 service nova] Creating event network-vif-deleted:7ce9b0c6-a42a-4be7-bfa3-19f0694292ee for instance c8647488-6b19-46a6-a95e-7280a2f63c58 on hv-cinder-81514 Oct 28 12:35:53.509291 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8f99b522-0ff7-4edd-ad63-192b84f6f861 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:53.509767 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8f99b522-0ff7-4edd-ad63-192b84f6f861 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:53.510417 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-ec121353-ac1e-450f-adde-d271dedd13de req-3a7a69d1-bbfb-4075-8b8a-216b034fe2d6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104858 Oct 28 12:35:53.510923 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8f99b522-0ff7-4edd-ad63-192b84f6f861 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:53.511425 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 400/801] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:35:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:35:53.511709 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8f99b522-0ff7-4edd-ad63-192b84f6f861 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:53.543917 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8f99b522-0ff7-4edd-ad63-192b84f6f861 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:53.544362 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8f99b522-0ff7-4edd-ad63-192b84f6f861 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:53.544824 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.objects.instance [None req-8f99b522-0ff7-4edd-ad63-192b84f6f861 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lazy-loading 'fault' on Instance uuid c8647488-6b19-46a6-a95e-7280a2f63c58 {{(pid=115876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:35:53.586519 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-8f99b522-0ff7-4edd-ad63-192b84f6f861 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec86adff43114c36a65f2bb590e4f6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36003ac4ee5e4de5b4ef1ed104c55b6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:35:53.594191 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-8f99b522-0ff7-4edd-ad63-192b84f6f861 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58" status: 200 len: 1307 microversion: 2.1 time: 0.097328 Oct 28 12:35:53.595144 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 402/802] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:53 2021] GET /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58 => generated 1307 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:35:53.604771 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-5eec51f5-9672-46e7-9379-a59819400c08 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:53.605739 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-5eec51f5-9672-46e7-9379-a59819400c08 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:53.612223 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5eec51f5-9672-46e7-9379-a59819400c08 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:53.612662 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5eec51f5-9672-46e7-9379-a59819400c08 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:53.613501 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5eec51f5-9672-46e7-9379-a59819400c08 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:53.613930 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5eec51f5-9672-46e7-9379-a59819400c08 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:53.679658 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-5eec51f5-9672-46e7-9379-a59819400c08 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 14 microversion: 2.1 time: 0.079075 Oct 28 12:35:53.680303 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 401/803] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:35:53 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:35:54.506883 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-f1a5dc47-efa2-44d1-aac3-25b2e7c446ad tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:54.509035 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-f1a5dc47-efa2-44d1-aac3-25b2e7c446ad tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:54.516379 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f1a5dc47-efa2-44d1-aac3-25b2e7c446ad tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:54.516854 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f1a5dc47-efa2-44d1-aac3-25b2e7c446ad tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:54.517666 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f1a5dc47-efa2-44d1-aac3-25b2e7c446ad tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:54.518072 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f1a5dc47-efa2-44d1-aac3-25b2e7c446ad tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:54.608980 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-f1a5dc47-efa2-44d1-aac3-25b2e7c446ad tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 33605 microversion: 2.20 time: 0.105958 Oct 28 12:35:54.610521 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 403/804] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:54 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 33605 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:35:54.614515 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-2ce6377d-1f9b-4405-802a-0ec0682d0248 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:35:54.615762 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-2ce6377d-1f9b-4405-802a-0ec0682d0248 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] [instance: c8647488-6b19-46a6-a95e-7280a2f63c58] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:54.626130 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2ce6377d-1f9b-4405-802a-0ec0682d0248 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:54.626751 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2ce6377d-1f9b-4405-802a-0ec0682d0248 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:54.627928 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2ce6377d-1f9b-4405-802a-0ec0682d0248 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:54.628854 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2ce6377d-1f9b-4405-802a-0ec0682d0248 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:54.645686 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.wsgi [None req-2ce6377d-1f9b-4405-802a-0ec0682d0248 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] HTTP exception thrown: Instance c8647488-6b19-46a6-a95e-7280a2f63c58 could not be found. Oct 28 12:35:54.646285 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-2ce6377d-1f9b-4405-802a-0ec0682d0248 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] Returning 404 to user: Instance c8647488-6b19-46a6-a95e-7280a2f63c58 could not be found. {{(pid=115877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:35:54.647086 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-2ce6377d-1f9b-4405-802a-0ec0682d0248 tempest-AttachVolumeNegativeTest-626561683 tempest-AttachVolumeNegativeTest-626561683-project] 10.222.0.62 "GET /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58" status: 404 len: 111 microversion: 2.1 time: 0.038536 Oct 28 12:35:54.647728 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 402/805] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:35:54 2021] GET /compute/v2.1/servers/c8647488-6b19-46a6-a95e-7280a2f63c58 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:35:54.691843 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-8a63afd6-3b0d-468d-ae20-601a9eab700c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:54.693278 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-8a63afd6-3b0d-468d-ae20-601a9eab700c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:54.701717 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8a63afd6-3b0d-468d-ae20-601a9eab700c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:54.702453 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8a63afd6-3b0d-468d-ae20-601a9eab700c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:54.703128 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8a63afd6-3b0d-468d-ae20-601a9eab700c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:54.703571 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8a63afd6-3b0d-468d-ae20-601a9eab700c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:54.772969 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-8a63afd6-3b0d-468d-ae20-601a9eab700c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 14 microversion: 2.1 time: 0.085259 Oct 28 12:35:54.773625 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 404/806] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:35:54 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 12:35:55.623429 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-c28fb2fe-c413-4909-8407-2e784309a17f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:55.624358 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-c28fb2fe-c413-4909-8407-2e784309a17f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:55.630873 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c28fb2fe-c413-4909-8407-2e784309a17f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:55.631301 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c28fb2fe-c413-4909-8407-2e784309a17f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:55.632085 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c28fb2fe-c413-4909-8407-2e784309a17f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:55.632520 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c28fb2fe-c413-4909-8407-2e784309a17f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:55.722066 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-c28fb2fe-c413-4909-8407-2e784309a17f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 34710 microversion: 2.20 time: 0.102357 Oct 28 12:35:55.723917 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 403/807] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:55 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 34710 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:35:55.785029 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-a1c87732-44f3-4a02-ad65-bdfdfb6fbc46 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:55.786133 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-a1c87732-44f3-4a02-ad65-bdfdfb6fbc46 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:55.793585 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a1c87732-44f3-4a02-ad65-bdfdfb6fbc46 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:55.794342 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a1c87732-44f3-4a02-ad65-bdfdfb6fbc46 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:55.794755 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a1c87732-44f3-4a02-ad65-bdfdfb6fbc46 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:55.795262 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a1c87732-44f3-4a02-ad65-bdfdfb6fbc46 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:55.862822 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-a1c87732-44f3-4a02-ad65-bdfdfb6fbc46 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 14 microversion: 2.1 time: 0.081855 Oct 28 12:35:55.863978 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 405/808] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:35:55 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:35:56.875136 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-ba461d71-80e7-4da2-b502-8b1b2dfba9a8 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:56.876126 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-ba461d71-80e7-4da2-b502-8b1b2dfba9a8 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:56.883444 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ba461d71-80e7-4da2-b502-8b1b2dfba9a8 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:56.883808 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ba461d71-80e7-4da2-b502-8b1b2dfba9a8 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:56.884794 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ba461d71-80e7-4da2-b502-8b1b2dfba9a8 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:56.885550 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ba461d71-80e7-4da2-b502-8b1b2dfba9a8 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:56.921003 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-36d6e9d1-4cba-4d97-9c6b-b9bd6829448a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:56.922027 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-36d6e9d1-4cba-4d97-9c6b-b9bd6829448a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:56.930304 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-36d6e9d1-4cba-4d97-9c6b-b9bd6829448a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:56.930770 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-36d6e9d1-4cba-4d97-9c6b-b9bd6829448a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:56.931531 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-36d6e9d1-4cba-4d97-9c6b-b9bd6829448a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:56.931978 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-36d6e9d1-4cba-4d97-9c6b-b9bd6829448a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:56.955582 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-ba461d71-80e7-4da2-b502-8b1b2dfba9a8 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 14 microversion: 2.1 time: 0.084149 Oct 28 12:35:56.956529 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 406/809] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:35:56 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:35:57.019905 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-36d6e9d1-4cba-4d97-9c6b-b9bd6829448a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 36095 microversion: 2.20 time: 0.288195 Oct 28 12:35:57.020625 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 404/810] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:56 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 36095 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:35:58.036057 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-f755b3a5-508a-4528-a96d-8040905681a3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:58.037117 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-f755b3a5-508a-4528-a96d-8040905681a3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:58.043683 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f755b3a5-508a-4528-a96d-8040905681a3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:58.044120 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f755b3a5-508a-4528-a96d-8040905681a3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:58.045128 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f755b3a5-508a-4528-a96d-8040905681a3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:58.045553 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f755b3a5-508a-4528-a96d-8040905681a3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:58.137286 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-f755b3a5-508a-4528-a96d-8040905681a3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 37725 microversion: 2.20 time: 0.107210 Oct 28 12:35:58.142271 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 405/811] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:58 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 37725 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:35:58.234152 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-a5f79453-947b-43dc-8dd8-e07286e304d6 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:58.235399 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-a5f79453-947b-43dc-8dd8-e07286e304d6 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:58.242862 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a5f79453-947b-43dc-8dd8-e07286e304d6 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:58.243426 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a5f79453-947b-43dc-8dd8-e07286e304d6 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:58.244294 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a5f79453-947b-43dc-8dd8-e07286e304d6 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:58.244816 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a5f79453-947b-43dc-8dd8-e07286e304d6 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:58.313784 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-a5f79453-947b-43dc-8dd8-e07286e304d6 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 14 microversion: 2.1 time: 0.349312 Oct 28 12:35:58.317246 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 407/812] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:35:57 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 14 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:35:59.150151 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-aa099782-4bcb-4a1e-84ab-ea231bd00b61 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:59.151142 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-aa099782-4bcb-4a1e-84ab-ea231bd00b61 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:59.157591 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-aa099782-4bcb-4a1e-84ab-ea231bd00b61 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:59.158031 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-aa099782-4bcb-4a1e-84ab-ea231bd00b61 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:59.159302 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-aa099782-4bcb-4a1e-84ab-ea231bd00b61 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:59.159302 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-aa099782-4bcb-4a1e-84ab-ea231bd00b61 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:59.244425 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-aa099782-4bcb-4a1e-84ab-ea231bd00b61 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 38204 microversion: 2.20 time: 0.098493 Oct 28 12:35:59.245227 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 406/813] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:35:59 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 38204 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:35:59.324753 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-f5d730ca-f3d7-48aa-a670-347aef5f4bbf tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:35:59.325709 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-f5d730ca-f3d7-48aa-a670-347aef5f4bbf tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:35:59.332983 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f5d730ca-f3d7-48aa-a670-347aef5f4bbf tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:59.333512 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f5d730ca-f3d7-48aa-a670-347aef5f4bbf tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:59.334291 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f5d730ca-f3d7-48aa-a670-347aef5f4bbf tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:35:59.334774 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f5d730ca-f3d7-48aa-a670-347aef5f4bbf tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:35:59.401592 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-f5d730ca-f3d7-48aa-a670-347aef5f4bbf tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 14 microversion: 2.1 time: 0.080814 Oct 28 12:35:59.401592 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 408/814] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:35:59 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:36:00.257965 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-2769d7ed-afcd-4bf0-a503-53a516a7ccca tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:00.258995 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-2769d7ed-afcd-4bf0-a503-53a516a7ccca tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:00.266186 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2769d7ed-afcd-4bf0-a503-53a516a7ccca tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:00.266687 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2769d7ed-afcd-4bf0-a503-53a516a7ccca tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:00.267478 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2769d7ed-afcd-4bf0-a503-53a516a7ccca tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:00.267944 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2769d7ed-afcd-4bf0-a503-53a516a7ccca tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:00.339620 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-2769d7ed-afcd-4bf0-a503-53a516a7ccca tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 38204 microversion: 2.20 time: 0.085191 Oct 28 12:36:00.340299 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 407/815] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:36:00 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 38204 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:36:00.412574 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-42a089a0-6c10-4891-8441-e2390059ff70 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:00.413773 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-42a089a0-6c10-4891-8441-e2390059ff70 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:00.420949 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-42a089a0-6c10-4891-8441-e2390059ff70 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:00.421389 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-42a089a0-6c10-4891-8441-e2390059ff70 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:00.422148 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-42a089a0-6c10-4891-8441-e2390059ff70 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:00.422847 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-42a089a0-6c10-4891-8441-e2390059ff70 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:00.490235 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-42a089a0-6c10-4891-8441-e2390059ff70 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 6451 microversion: 2.1 time: 0.081900 Oct 28 12:36:00.490874 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 409/816] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:36:00 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 6451 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:36:01.352295 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-df320f81-547d-4c69-bcdb-4997341bf079 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:01.353651 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-df320f81-547d-4c69-bcdb-4997341bf079 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:01.361052 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-df320f81-547d-4c69-bcdb-4997341bf079 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:01.361490 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-df320f81-547d-4c69-bcdb-4997341bf079 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:01.362259 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-df320f81-547d-4c69-bcdb-4997341bf079 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:01.362690 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-df320f81-547d-4c69-bcdb-4997341bf079 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:01.429596 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-df320f81-547d-4c69-bcdb-4997341bf079 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 38204 microversion: 2.20 time: 0.081351 Oct 28 12:36:01.430281 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 408/817] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:36:01 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 38204 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:36:01.502278 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-2e0b9f1e-54e6-4b2c-987d-b1366804128d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:01.503185 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-2e0b9f1e-54e6-4b2c-987d-b1366804128d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:01.510627 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2e0b9f1e-54e6-4b2c-987d-b1366804128d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:01.511229 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2e0b9f1e-54e6-4b2c-987d-b1366804128d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:01.511993 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2e0b9f1e-54e6-4b2c-987d-b1366804128d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:01.512411 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2e0b9f1e-54e6-4b2c-987d-b1366804128d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:01.595526 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-2e0b9f1e-54e6-4b2c-987d-b1366804128d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 15025 microversion: 2.1 time: 0.097579 Oct 28 12:36:01.596218 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 410/818] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:36:01 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 15025 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:36:02.444028 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-5addb6bf-b55f-4b48-a75c-ee5a74677823 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:02.445804 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-5addb6bf-b55f-4b48-a75c-ee5a74677823 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:02.453706 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5addb6bf-b55f-4b48-a75c-ee5a74677823 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:02.454581 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5addb6bf-b55f-4b48-a75c-ee5a74677823 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:02.455543 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5addb6bf-b55f-4b48-a75c-ee5a74677823 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:02.455969 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5addb6bf-b55f-4b48-a75c-ee5a74677823 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:02.540504 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-5addb6bf-b55f-4b48-a75c-ee5a74677823 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 38212 microversion: 2.20 time: 0.100740 Oct 28 12:36:02.542473 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 409/819] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:36:02 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 38212 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:36:02.609189 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-36540997-9c41-413c-b530-46417cfd990a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:02.610202 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-36540997-9c41-413c-b530-46417cfd990a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:02.617959 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-36540997-9c41-413c-b530-46417cfd990a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:02.618406 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-36540997-9c41-413c-b530-46417cfd990a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:02.619189 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-36540997-9c41-413c-b530-46417cfd990a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:02.619616 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-36540997-9c41-413c-b530-46417cfd990a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:02.709635 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-36540997-9c41-413c-b530-46417cfd990a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 18356 microversion: 2.1 time: 0.105132 Oct 28 12:36:02.710312 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 411/820] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:36:02 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 18356 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:36:03.558266 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-cf0749c4-0925-4d4b-ad0e-e843017dc9a2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:03.559340 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-cf0749c4-0925-4d4b-ad0e-e843017dc9a2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:03.566625 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-cf0749c4-0925-4d4b-ad0e-e843017dc9a2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:03.567069 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-cf0749c4-0925-4d4b-ad0e-e843017dc9a2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:03.567850 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-cf0749c4-0925-4d4b-ad0e-e843017dc9a2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:03.568287 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-cf0749c4-0925-4d4b-ad0e-e843017dc9a2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:03.651145 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-cf0749c4-0925-4d4b-ad0e-e843017dc9a2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 200 len: 38344 microversion: 2.20 time: 0.097174 Oct 28 12:36:03.652069 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 410/821] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:36:03 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 38344 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:36:03.662535 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-93b935ee-ad11-45b8-a1fe-43f054ba0c5a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:03.663162 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-93b935ee-ad11-45b8-a1fe-43f054ba0c5a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:03.672810 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-93b935ee-ad11-45b8-a1fe-43f054ba0c5a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:03.673449 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-93b935ee-ad11-45b8-a1fe-43f054ba0c5a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:03.674544 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-93b935ee-ad11-45b8-a1fe-43f054ba0c5a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:03.675055 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-93b935ee-ad11-45b8-a1fe-43f054ba0c5a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:03.703787 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-93b935ee-ad11-45b8-a1fe-43f054ba0c5a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/ips" status: 200 len: 150 microversion: 2.20 time: 0.044311 Oct 28 12:36:03.703787 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 412/822] 10.222.0.62 () {60 vars in 1288 bytes} [Thu Oct 28 12:36:03 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:36:03.722449 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-a64d24d7-fc96-4389-9329-5beeddb2a820 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:03.723454 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-a64d24d7-fc96-4389-9329-5beeddb2a820 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:03.730983 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a64d24d7-fc96-4389-9329-5beeddb2a820 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:03.731451 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a64d24d7-fc96-4389-9329-5beeddb2a820 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:03.732230 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a64d24d7-fc96-4389-9329-5beeddb2a820 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:03.732851 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a64d24d7-fc96-4389-9329-5beeddb2a820 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:03.815598 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-a64d24d7-fc96-4389-9329-5beeddb2a820 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 19342 microversion: 2.1 time: 0.096816 Oct 28 12:36:03.821073 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 411/823] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:36:03 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 19342 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:36:04.829695 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-46d9ebc5-ecc6-41ea-a258-c4411c14db81 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:04.830681 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-46d9ebc5-ecc6-41ea-a258-c4411c14db81 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:04.838061 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-46d9ebc5-ecc6-41ea-a258-c4411c14db81 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:04.838484 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-46d9ebc5-ecc6-41ea-a258-c4411c14db81 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:04.839282 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-46d9ebc5-ecc6-41ea-a258-c4411c14db81 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:04.839705 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-46d9ebc5-ecc6-41ea-a258-c4411c14db81 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:06.853205 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-46d9ebc5-ecc6-41ea-a258-c4411c14db81 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 24322 microversion: 2.1 time: 2.026541 Oct 28 12:36:06.854214 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 413/824] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:36:04 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 24322 bytes in 2029 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:36:07.838120 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-92b01993-e2f9-4cf2-9d35-ca76ffb9b3fe tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:07.838699 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-92b01993-e2f9-4cf2-9d35-ca76ffb9b3fe tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:07.846052 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-92b01993-e2f9-4cf2-9d35-ca76ffb9b3fe tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:07.846516 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-92b01993-e2f9-4cf2-9d35-ca76ffb9b3fe tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:07.847370 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-92b01993-e2f9-4cf2-9d35-ca76ffb9b3fe tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:07.847805 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-92b01993-e2f9-4cf2-9d35-ca76ffb9b3fe tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:07.867996 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-5d542bf4-e004-4e00-9dfa-fd6fc74234d0 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:07.869587 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-5d542bf4-e004-4e00-9dfa-fd6fc74234d0 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:07.879754 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5d542bf4-e004-4e00-9dfa-fd6fc74234d0 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:07.880196 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5d542bf4-e004-4e00-9dfa-fd6fc74234d0 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:07.881000 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5d542bf4-e004-4e00-9dfa-fd6fc74234d0 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:07.881291 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.objects.instance [None req-92b01993-e2f9-4cf2-9d35-ca76ffb9b3fe tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lazy-loading 'flavor' on Instance uuid c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 {{(pid=115877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:36:07.881500 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5d542bf4-e004-4e00-9dfa-fd6fc74234d0 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:07.974327 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-5d542bf4-e004-4e00-9dfa-fd6fc74234d0 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 25839 microversion: 2.1 time: 0.110904 Oct 28 12:36:07.975263 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 414/825] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:36:07 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 25839 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:36:08.201831 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-92b01993-e2f9-4cf2-9d35-ca76ffb9b3fe tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 202 len: 0 microversion: 2.20 time: 0.368190 Oct 28 12:36:08.202529 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 412/826] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:36:07 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:36:08.212149 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-4e2ca090-9bcd-400d-a425-62fa49183582 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:08.212903 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-4e2ca090-9bcd-400d-a425-62fa49183582 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:08.219485 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4e2ca090-9bcd-400d-a425-62fa49183582 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:08.219925 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4e2ca090-9bcd-400d-a425-62fa49183582 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:08.221017 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4e2ca090-9bcd-400d-a425-62fa49183582 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:08.221180 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4e2ca090-9bcd-400d-a425-62fa49183582 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:08.350338 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-4e2ca090-9bcd-400d-a425-62fa49183582 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:08.361446 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-4e2ca090-9bcd-400d-a425-62fa49183582 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:08.362910 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-4e2ca090-9bcd-400d-a425-62fa49183582 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:08.364061 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-4e2ca090-9bcd-400d-a425-62fa49183582 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1720 microversion: 2.20 time: 0.156895 Oct 28 12:36:08.364629 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 415/827] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:08 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:36:08.988213 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-597f5b41-9fea-4fa0-86cf-ed1b4e73eecb tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:08.989326 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-597f5b41-9fea-4fa0-86cf-ed1b4e73eecb tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:08.996870 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-597f5b41-9fea-4fa0-86cf-ed1b4e73eecb tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:08.997313 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-597f5b41-9fea-4fa0-86cf-ed1b4e73eecb tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:08.998081 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-597f5b41-9fea-4fa0-86cf-ed1b4e73eecb tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:08.998506 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-597f5b41-9fea-4fa0-86cf-ed1b4e73eecb tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:09.386977 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-bcab549f-8125-4c83-b723-80d8e063b51a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:09.388056 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-bcab549f-8125-4c83-b723-80d8e063b51a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:09.398470 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-bcab549f-8125-4c83-b723-80d8e063b51a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:09.399196 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-bcab549f-8125-4c83-b723-80d8e063b51a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:09.400446 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-bcab549f-8125-4c83-b723-80d8e063b51a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:09.401213 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-bcab549f-8125-4c83-b723-80d8e063b51a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:09.537405 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-bcab549f-8125-4c83-b723-80d8e063b51a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:09.545435 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-bcab549f-8125-4c83-b723-80d8e063b51a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:09.546937 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-bcab549f-8125-4c83-b723-80d8e063b51a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:09.548100 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-bcab549f-8125-4c83-b723-80d8e063b51a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1720 microversion: 2.20 time: 0.167546 Oct 28 12:36:09.548662 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 416/828] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:09 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:36:10.571425 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-2c650c3a-d00d-4e51-9789-2021a37692ac tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:10.572106 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-2c650c3a-d00d-4e51-9789-2021a37692ac tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:10.580130 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2c650c3a-d00d-4e51-9789-2021a37692ac tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:10.580587 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2c650c3a-d00d-4e51-9789-2021a37692ac tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:10.581722 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2c650c3a-d00d-4e51-9789-2021a37692ac tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:10.582216 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2c650c3a-d00d-4e51-9789-2021a37692ac tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:10.717599 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-2c650c3a-d00d-4e51-9789-2021a37692ac tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:10.726366 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-2c650c3a-d00d-4e51-9789-2021a37692ac tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:10.727881 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-2c650c3a-d00d-4e51-9789-2021a37692ac tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:10.729319 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-2c650c3a-d00d-4e51-9789-2021a37692ac tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1720 microversion: 2.20 time: 0.161711 Oct 28 12:36:10.729913 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 417/829] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:10 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:36:11.264024 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-597f5b41-9fea-4fa0-86cf-ed1b4e73eecb tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 27670 microversion: 2.1 time: 2.280270 Oct 28 12:36:11.264804 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 413/830] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:36:08 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 27670 bytes in 2283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:36:11.750278 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-aa677715-7b84-42d9-aed5-328f33d8b4e1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:11.750882 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-aa677715-7b84-42d9-aed5-328f33d8b4e1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:11.757300 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-aa677715-7b84-42d9-aed5-328f33d8b4e1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:11.757744 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-aa677715-7b84-42d9-aed5-328f33d8b4e1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:11.758498 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-aa677715-7b84-42d9-aed5-328f33d8b4e1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:11.758921 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-aa677715-7b84-42d9-aed5-328f33d8b4e1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:11.893380 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-aa677715-7b84-42d9-aed5-328f33d8b4e1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:11.901557 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-aa677715-7b84-42d9-aed5-328f33d8b4e1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:11.903037 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-aa677715-7b84-42d9-aed5-328f33d8b4e1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:11.904305 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-aa677715-7b84-42d9-aed5-328f33d8b4e1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1720 microversion: 2.20 time: 0.159279 Oct 28 12:36:11.904932 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 418/831] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:11 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:36:12.277239 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-7b199cda-956e-42f9-8917-7d40b3647937 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:12.278237 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-7b199cda-956e-42f9-8917-7d40b3647937 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:12.286000 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7b199cda-956e-42f9-8917-7d40b3647937 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:12.286446 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7b199cda-956e-42f9-8917-7d40b3647937 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:12.287259 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7b199cda-956e-42f9-8917-7d40b3647937 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:12.287690 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7b199cda-956e-42f9-8917-7d40b3647937 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:12.377176 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-7b199cda-956e-42f9-8917-7d40b3647937 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 28180 microversion: 2.1 time: 0.103867 Oct 28 12:36:12.378066 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 414/832] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:36:12 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 28180 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:36:12.922963 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-b62c8c1a-be95-463e-aa11-9d03f763303f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:12.923571 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-b62c8c1a-be95-463e-aa11-9d03f763303f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:12.930497 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b62c8c1a-be95-463e-aa11-9d03f763303f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:12.930937 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b62c8c1a-be95-463e-aa11-9d03f763303f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:12.931736 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b62c8c1a-be95-463e-aa11-9d03f763303f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:12.932172 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b62c8c1a-be95-463e-aa11-9d03f763303f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:13.069226 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-b62c8c1a-be95-463e-aa11-9d03f763303f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:13.077568 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-b62c8c1a-be95-463e-aa11-9d03f763303f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:13.079036 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-b62c8c1a-be95-463e-aa11-9d03f763303f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:13.080164 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-b62c8c1a-be95-463e-aa11-9d03f763303f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1720 microversion: 2.20 time: 0.161349 Oct 28 12:36:13.080751 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 419/833] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:12 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:36:13.389242 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-0210d0d8-bc6e-4aaf-bfe6-3ed0c31b47cd tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:13.390237 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-0210d0d8-bc6e-4aaf-bfe6-3ed0c31b47cd tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:13.397611 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0210d0d8-bc6e-4aaf-bfe6-3ed0c31b47cd tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:13.398055 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0210d0d8-bc6e-4aaf-bfe6-3ed0c31b47cd tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:13.398820 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0210d0d8-bc6e-4aaf-bfe6-3ed0c31b47cd tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:13.399247 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0210d0d8-bc6e-4aaf-bfe6-3ed0c31b47cd tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:13.466573 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-0210d0d8-bc6e-4aaf-bfe6-3ed0c31b47cd tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 28180 microversion: 2.1 time: 0.081258 Oct 28 12:36:13.467295 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 415/834] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:36:13 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 28180 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:36:14.098672 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-918920a7-6a21-4b4d-8bca-31c0bea8958e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:14.099254 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-918920a7-6a21-4b4d-8bca-31c0bea8958e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:14.108892 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-918920a7-6a21-4b4d-8bca-31c0bea8958e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:14.109334 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-918920a7-6a21-4b4d-8bca-31c0bea8958e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:14.110193 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-918920a7-6a21-4b4d-8bca-31c0bea8958e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:14.110597 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-918920a7-6a21-4b4d-8bca-31c0bea8958e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:14.250198 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-918920a7-6a21-4b4d-8bca-31c0bea8958e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:14.258495 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-918920a7-6a21-4b4d-8bca-31c0bea8958e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:14.259975 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-918920a7-6a21-4b4d-8bca-31c0bea8958e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:14.261204 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-918920a7-6a21-4b4d-8bca-31c0bea8958e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1720 microversion: 2.20 time: 0.166380 Oct 28 12:36:14.261772 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 420/835] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:14 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:36:14.481712 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-7c622633-80dd-4ad4-aaa7-39c9fdf27bea tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:14.482897 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-7c622633-80dd-4ad4-aaa7-39c9fdf27bea tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:14.490232 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7c622633-80dd-4ad4-aaa7-39c9fdf27bea tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:14.490685 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7c622633-80dd-4ad4-aaa7-39c9fdf27bea tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:14.491456 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7c622633-80dd-4ad4-aaa7-39c9fdf27bea tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:14.491885 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7c622633-80dd-4ad4-aaa7-39c9fdf27bea tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:14.558676 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-7c622633-80dd-4ad4-aaa7-39c9fdf27bea tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 28180 microversion: 2.1 time: 0.082518 Oct 28 12:36:14.559321 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 416/836] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:36:14 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 28180 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:36:15.282290 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-2f81258b-d0bb-40a9-aeff-a33371ab551e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:15.282866 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-2f81258b-d0bb-40a9-aeff-a33371ab551e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:15.291778 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2f81258b-d0bb-40a9-aeff-a33371ab551e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:15.292357 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2f81258b-d0bb-40a9-aeff-a33371ab551e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:15.293716 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2f81258b-d0bb-40a9-aeff-a33371ab551e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:15.294280 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2f81258b-d0bb-40a9-aeff-a33371ab551e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:15.423846 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-2f81258b-d0bb-40a9-aeff-a33371ab551e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:15.432509 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-2f81258b-d0bb-40a9-aeff-a33371ab551e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:15.434099 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-2f81258b-d0bb-40a9-aeff-a33371ab551e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:15.435270 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-2f81258b-d0bb-40a9-aeff-a33371ab551e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1720 microversion: 2.20 time: 0.158643 Oct 28 12:36:15.435890 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 421/837] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:15 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:36:15.574611 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-7decbf59-dbf5-4570-a268-96a7723a58ad tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:15.576003 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-7decbf59-dbf5-4570-a268-96a7723a58ad tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:15.586784 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7decbf59-dbf5-4570-a268-96a7723a58ad tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:15.587473 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7decbf59-dbf5-4570-a268-96a7723a58ad tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:15.588649 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7decbf59-dbf5-4570-a268-96a7723a58ad tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:15.589360 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7decbf59-dbf5-4570-a268-96a7723a58ad tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:16.454188 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-01b4a786-f023-44bb-b939-2e555550fca4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:16.454758 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-01b4a786-f023-44bb-b939-2e555550fca4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:16.461780 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-01b4a786-f023-44bb-b939-2e555550fca4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:16.462253 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-01b4a786-f023-44bb-b939-2e555550fca4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:16.463047 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-01b4a786-f023-44bb-b939-2e555550fca4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:16.463489 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-01b4a786-f023-44bb-b939-2e555550fca4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:16.605714 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-01b4a786-f023-44bb-b939-2e555550fca4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:16.614550 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-01b4a786-f023-44bb-b939-2e555550fca4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:16.616027 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-01b4a786-f023-44bb-b939-2e555550fca4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:16.617231 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-01b4a786-f023-44bb-b939-2e555550fca4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1720 microversion: 2.20 time: 0.167282 Oct 28 12:36:16.617799 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 422/838] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:16 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:36:17.635486 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-f0b36a76-4467-45dc-a50b-bb0550f7d300 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:17.636327 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-f0b36a76-4467-45dc-a50b-bb0550f7d300 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:17.642575 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f0b36a76-4467-45dc-a50b-bb0550f7d300 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:17.643011 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f0b36a76-4467-45dc-a50b-bb0550f7d300 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:17.643768 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f0b36a76-4467-45dc-a50b-bb0550f7d300 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:17.644187 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f0b36a76-4467-45dc-a50b-bb0550f7d300 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:17.784172 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f0b36a76-4467-45dc-a50b-bb0550f7d300 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:17.792143 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f0b36a76-4467-45dc-a50b-bb0550f7d300 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:17.793649 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f0b36a76-4467-45dc-a50b-bb0550f7d300 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:17.794865 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-f0b36a76-4467-45dc-a50b-bb0550f7d300 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1720 microversion: 2.20 time: 0.163102 Oct 28 12:36:17.795629 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 423/839] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:17 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:36:17.906595 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-7decbf59-dbf5-4570-a268-96a7723a58ad tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 28471 microversion: 2.1 time: 2.338262 Oct 28 12:36:17.907366 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 417/840] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:36:15 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 28471 bytes in 2340 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:36:18.816924 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-8e0c1be0-8ef3-47fd-aad2-229a8e9af48a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:18.818014 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-8e0c1be0-8ef3-47fd-aad2-229a8e9af48a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:18.827943 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8e0c1be0-8ef3-47fd-aad2-229a8e9af48a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:18.828514 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8e0c1be0-8ef3-47fd-aad2-229a8e9af48a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:18.830028 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8e0c1be0-8ef3-47fd-aad2-229a8e9af48a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:18.830170 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8e0c1be0-8ef3-47fd-aad2-229a8e9af48a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:18.919266 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-5e624727-871e-4566-9137-ee49a129f5c4 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:18.920446 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-5e624727-871e-4566-9137-ee49a129f5c4 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:18.929069 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5e624727-871e-4566-9137-ee49a129f5c4 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:18.929607 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5e624727-871e-4566-9137-ee49a129f5c4 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:18.930455 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5e624727-871e-4566-9137-ee49a129f5c4 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:18.930888 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5e624727-871e-4566-9137-ee49a129f5c4 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:18.964129 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-8e0c1be0-8ef3-47fd-aad2-229a8e9af48a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:18.975288 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-8e0c1be0-8ef3-47fd-aad2-229a8e9af48a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:18.977666 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-8e0c1be0-8ef3-47fd-aad2-229a8e9af48a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:18.979500 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-8e0c1be0-8ef3-47fd-aad2-229a8e9af48a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1720 microversion: 2.20 time: 0.167768 Oct 28 12:36:18.980119 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 424/841] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:18 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:36:19.009991 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-5e624727-871e-4566-9137-ee49a129f5c4 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 28566 microversion: 2.1 time: 0.094855 Oct 28 12:36:19.010682 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 418/842] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:36:18 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 28566 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:36:19.998803 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-020a1fdc-a17b-44fa-84f4-f2b69a2809eb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:19.999656 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-020a1fdc-a17b-44fa-84f4-f2b69a2809eb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:20.007634 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-020a1fdc-a17b-44fa-84f4-f2b69a2809eb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:20.008233 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-020a1fdc-a17b-44fa-84f4-f2b69a2809eb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:20.009071 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-020a1fdc-a17b-44fa-84f4-f2b69a2809eb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:20.009491 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-020a1fdc-a17b-44fa-84f4-f2b69a2809eb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:20.022765 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-f66f60ea-afcb-4118-b4ab-77bbdc185a0a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:20.024744 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-f66f60ea-afcb-4118-b4ab-77bbdc185a0a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:20.032850 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f66f60ea-afcb-4118-b4ab-77bbdc185a0a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:20.033423 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f66f60ea-afcb-4118-b4ab-77bbdc185a0a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:20.034353 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f66f60ea-afcb-4118-b4ab-77bbdc185a0a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:20.034915 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f66f60ea-afcb-4118-b4ab-77bbdc185a0a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:20.118668 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-f66f60ea-afcb-4118-b4ab-77bbdc185a0a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 28638 microversion: 2.1 time: 0.100484 Oct 28 12:36:20.119318 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 419/843] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:36:20 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 28638 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:36:20.144165 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-020a1fdc-a17b-44fa-84f4-f2b69a2809eb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:20.152393 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-020a1fdc-a17b-44fa-84f4-f2b69a2809eb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:20.153888 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-020a1fdc-a17b-44fa-84f4-f2b69a2809eb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:20.155167 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-020a1fdc-a17b-44fa-84f4-f2b69a2809eb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1720 microversion: 2.20 time: 0.160356 Oct 28 12:36:20.155734 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 425/844] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:19 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:36:21.131520 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-8e675ad8-b415-4651-abbf-cd73f984730c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:21.132549 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-8e675ad8-b415-4651-abbf-cd73f984730c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:21.139798 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8e675ad8-b415-4651-abbf-cd73f984730c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:21.140236 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8e675ad8-b415-4651-abbf-cd73f984730c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:21.141039 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8e675ad8-b415-4651-abbf-cd73f984730c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:21.141438 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-8e675ad8-b415-4651-abbf-cd73f984730c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:21.173450 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-0196dd33-2f7b-4a9c-9b0d-e79f233e37f0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:21.174048 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-0196dd33-2f7b-4a9c-9b0d-e79f233e37f0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:21.181139 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-0196dd33-2f7b-4a9c-9b0d-e79f233e37f0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:21.181582 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-0196dd33-2f7b-4a9c-9b0d-e79f233e37f0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:21.182337 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-0196dd33-2f7b-4a9c-9b0d-e79f233e37f0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:21.182764 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-0196dd33-2f7b-4a9c-9b0d-e79f233e37f0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:21.204597 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-8e675ad8-b415-4651-abbf-cd73f984730c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 28638 microversion: 2.1 time: 0.077067 Oct 28 12:36:21.205253 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 420/845] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:36:21 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 28638 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:36:21.310675 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-0196dd33-2f7b-4a9c-9b0d-e79f233e37f0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:21.318812 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-0196dd33-2f7b-4a9c-9b0d-e79f233e37f0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:21.320287 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-0196dd33-2f7b-4a9c-9b0d-e79f233e37f0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:21.321486 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-0196dd33-2f7b-4a9c-9b0d-e79f233e37f0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1720 microversion: 2.20 time: 0.151813 Oct 28 12:36:21.322042 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 426/846] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:21 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:36:22.217001 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-6575dd05-b62e-456e-8d98-c7bb49321dda tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:22.218823 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-6575dd05-b62e-456e-8d98-c7bb49321dda tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:22.225663 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6575dd05-b62e-456e-8d98-c7bb49321dda tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:22.226102 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6575dd05-b62e-456e-8d98-c7bb49321dda tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:22.226855 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6575dd05-b62e-456e-8d98-c7bb49321dda tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:22.227475 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6575dd05-b62e-456e-8d98-c7bb49321dda tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:22.292289 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-6575dd05-b62e-456e-8d98-c7bb49321dda tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 28638 microversion: 2.1 time: 0.079215 Oct 28 12:36:22.292975 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 421/847] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:36:22 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 28638 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:36:22.339330 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-f9aab7ff-e4e1-467b-8d9d-ea285e2eaa00 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:22.339912 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-f9aab7ff-e4e1-467b-8d9d-ea285e2eaa00 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:22.347012 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f9aab7ff-e4e1-467b-8d9d-ea285e2eaa00 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:22.347486 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f9aab7ff-e4e1-467b-8d9d-ea285e2eaa00 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:22.348318 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f9aab7ff-e4e1-467b-8d9d-ea285e2eaa00 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:22.348767 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f9aab7ff-e4e1-467b-8d9d-ea285e2eaa00 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:22.479920 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f9aab7ff-e4e1-467b-8d9d-ea285e2eaa00 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:22.488863 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f9aab7ff-e4e1-467b-8d9d-ea285e2eaa00 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:22.490438 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f9aab7ff-e4e1-467b-8d9d-ea285e2eaa00 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:22.491680 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-f9aab7ff-e4e1-467b-8d9d-ea285e2eaa00 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1720 microversion: 2.20 time: 0.156136 Oct 28 12:36:22.492235 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 427/848] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:22 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:36:23.304452 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-e18d7a7f-3e71-40ca-8ecc-f08086241c86 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:23.305283 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-e18d7a7f-3e71-40ca-8ecc-f08086241c86 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:23.312208 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e18d7a7f-3e71-40ca-8ecc-f08086241c86 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:23.312643 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e18d7a7f-3e71-40ca-8ecc-f08086241c86 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:23.313476 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e18d7a7f-3e71-40ca-8ecc-f08086241c86 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:23.313899 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e18d7a7f-3e71-40ca-8ecc-f08086241c86 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:23.394338 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-e18d7a7f-3e71-40ca-8ecc-f08086241c86 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 29457 microversion: 2.1 time: 0.094299 Oct 28 12:36:23.398373 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 422/849] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:36:23 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 29457 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:36:23.509774 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-a99a54da-dbe5-4f56-8cc8-2e97f7b46ad7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:23.510442 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-a99a54da-dbe5-4f56-8cc8-2e97f7b46ad7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:23.517184 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a99a54da-dbe5-4f56-8cc8-2e97f7b46ad7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:23.517646 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a99a54da-dbe5-4f56-8cc8-2e97f7b46ad7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:23.518425 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a99a54da-dbe5-4f56-8cc8-2e97f7b46ad7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:23.518817 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a99a54da-dbe5-4f56-8cc8-2e97f7b46ad7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:23.647208 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-a99a54da-dbe5-4f56-8cc8-2e97f7b46ad7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:23.656956 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-a99a54da-dbe5-4f56-8cc8-2e97f7b46ad7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:23.658529 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-a99a54da-dbe5-4f56-8cc8-2e97f7b46ad7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:23.659668 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-a99a54da-dbe5-4f56-8cc8-2e97f7b46ad7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1720 microversion: 2.20 time: 0.153687 Oct 28 12:36:23.660224 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 428/850] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:23 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:36:24.408435 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-470fbc53-bf54-475f-bf2f-20c630a3f91c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:24.409411 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-470fbc53-bf54-475f-bf2f-20c630a3f91c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:24.417437 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-470fbc53-bf54-475f-bf2f-20c630a3f91c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:24.418093 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-470fbc53-bf54-475f-bf2f-20c630a3f91c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:24.418751 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-470fbc53-bf54-475f-bf2f-20c630a3f91c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:24.419143 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-470fbc53-bf54-475f-bf2f-20c630a3f91c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:24.511567 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-470fbc53-bf54-475f-bf2f-20c630a3f91c tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 30931 microversion: 2.1 time: 0.107033 Oct 28 12:36:24.513731 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 423/851] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:36:24 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 30931 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:36:24.681267 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-d1b64d6a-987a-4afa-85e7-e1c9036c1376 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:24.681976 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-d1b64d6a-987a-4afa-85e7-e1c9036c1376 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:24.690744 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d1b64d6a-987a-4afa-85e7-e1c9036c1376 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:24.691406 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d1b64d6a-987a-4afa-85e7-e1c9036c1376 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:24.692451 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d1b64d6a-987a-4afa-85e7-e1c9036c1376 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:24.693116 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-d1b64d6a-987a-4afa-85e7-e1c9036c1376 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:24.829709 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-d1b64d6a-987a-4afa-85e7-e1c9036c1376 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:24.840220 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-d1b64d6a-987a-4afa-85e7-e1c9036c1376 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:24.842086 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-d1b64d6a-987a-4afa-85e7-e1c9036c1376 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:24.843477 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-d1b64d6a-987a-4afa-85e7-e1c9036c1376 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1741 microversion: 2.20 time: 0.168166 Oct 28 12:36:24.844044 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 429/852] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:24 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1741 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:36:25.526946 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-da6d893f-5c1e-4d1f-a3c1-c59ba719a46a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:25.527952 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-da6d893f-5c1e-4d1f-a3c1-c59ba719a46a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:25.535232 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-da6d893f-5c1e-4d1f-a3c1-c59ba719a46a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:25.536037 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-da6d893f-5c1e-4d1f-a3c1-c59ba719a46a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:25.536990 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-da6d893f-5c1e-4d1f-a3c1-c59ba719a46a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:25.537238 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-da6d893f-5c1e-4d1f-a3c1-c59ba719a46a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:25.638908 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-da6d893f-5c1e-4d1f-a3c1-c59ba719a46a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 32390 microversion: 2.1 time: 0.115721 Oct 28 12:36:25.639845 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 424/853] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:36:25 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 32390 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:36:25.866086 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-897bb1cb-4276-4087-8d5b-73e77856aa49 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:25.866727 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-897bb1cb-4276-4087-8d5b-73e77856aa49 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:25.875656 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-897bb1cb-4276-4087-8d5b-73e77856aa49 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:25.876098 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-897bb1cb-4276-4087-8d5b-73e77856aa49 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:25.877031 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-897bb1cb-4276-4087-8d5b-73e77856aa49 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:25.877376 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-897bb1cb-4276-4087-8d5b-73e77856aa49 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:26.008356 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-897bb1cb-4276-4087-8d5b-73e77856aa49 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:26.019109 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-897bb1cb-4276-4087-8d5b-73e77856aa49 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:26.021560 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-897bb1cb-4276-4087-8d5b-73e77856aa49 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:26.023210 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-897bb1cb-4276-4087-8d5b-73e77856aa49 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1741 microversion: 2.20 time: 0.163088 Oct 28 12:36:26.023753 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 430/854] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:25 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1741 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:36:26.651012 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-eddfa220-2743-4acc-9499-14228d288618 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:26.652010 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-eddfa220-2743-4acc-9499-14228d288618 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:26.659353 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-eddfa220-2743-4acc-9499-14228d288618 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:26.660113 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-eddfa220-2743-4acc-9499-14228d288618 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:26.661132 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-eddfa220-2743-4acc-9499-14228d288618 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:26.661785 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-eddfa220-2743-4acc-9499-14228d288618 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:26.747271 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-eddfa220-2743-4acc-9499-14228d288618 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 33510 microversion: 2.1 time: 0.100078 Oct 28 12:36:26.752846 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 425/855] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:36:26 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 33510 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:36:27.042990 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-4615d0d0-377b-43ca-8392-3095f78c6be5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:27.044425 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-4615d0d0-377b-43ca-8392-3095f78c6be5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:27.057791 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4615d0d0-377b-43ca-8392-3095f78c6be5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:27.058723 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4615d0d0-377b-43ca-8392-3095f78c6be5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:27.059827 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4615d0d0-377b-43ca-8392-3095f78c6be5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:27.060524 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4615d0d0-377b-43ca-8392-3095f78c6be5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:27.162202 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-b445ee06-c068-4f16-937c-2faa956ce5f5 req-71abfd70-c791-4630-9911-0471046baa41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726", "name": "network-vif-plugged", "status": "completed", "tag": "c25d48e4-43fb-464d-a891-6f40b7296a25"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:27.163931 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:36:27.163931 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:36:27.175761 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-b445ee06-c068-4f16-937c-2faa956ce5f5 req-71abfd70-c791-4630-9911-0471046baa41 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:27.176242 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-b445ee06-c068-4f16-937c-2faa956ce5f5 req-71abfd70-c791-4630-9911-0471046baa41 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:27.190408 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-b445ee06-c068-4f16-937c-2faa956ce5f5 req-71abfd70-c791-4630-9911-0471046baa41 service nova] Creating event network-vif-plugged:c25d48e4-43fb-464d-a891-6f40b7296a25 for instance c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 on hv-cinder-81514 Oct 28 12:36:27.197905 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-b445ee06-c068-4f16-937c-2faa956ce5f5 req-71abfd70-c791-4630-9911-0471046baa41 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.223565 Oct 28 12:36:27.199329 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 431/856] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:36:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:36:27.243761 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-4615d0d0-377b-43ca-8392-3095f78c6be5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:27.252445 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-4615d0d0-377b-43ca-8392-3095f78c6be5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:27.254305 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-4615d0d0-377b-43ca-8392-3095f78c6be5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:27.255378 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-4615d0d0-377b-43ca-8392-3095f78c6be5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1736 microversion: 2.20 time: 0.218148 Oct 28 12:36:27.256019 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 426/857] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:27 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:36:27.775025 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-032ef51e-f8be-4a70-98f4-f80198b89b72 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:27.782386 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-032ef51e-f8be-4a70-98f4-f80198b89b72 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:27.793529 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-032ef51e-f8be-4a70-98f4-f80198b89b72 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:27.794130 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-032ef51e-f8be-4a70-98f4-f80198b89b72 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:27.794979 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-032ef51e-f8be-4a70-98f4-f80198b89b72 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:27.795521 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-032ef51e-f8be-4a70-98f4-f80198b89b72 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:27.898583 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-032ef51e-f8be-4a70-98f4-f80198b89b72 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 34383 microversion: 2.1 time: 0.139813 Oct 28 12:36:27.900036 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 432/858] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:36:27 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 34383 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:36:28.274163 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-146adfbc-571f-4d49-8d82-3223c16e44eb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:28.275654 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-146adfbc-571f-4d49-8d82-3223c16e44eb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:28.283855 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-146adfbc-571f-4d49-8d82-3223c16e44eb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:28.284197 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-146adfbc-571f-4d49-8d82-3223c16e44eb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:28.285009 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-146adfbc-571f-4d49-8d82-3223c16e44eb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:28.285586 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-146adfbc-571f-4d49-8d82-3223c16e44eb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:28.435806 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-146adfbc-571f-4d49-8d82-3223c16e44eb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:28.445059 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-146adfbc-571f-4d49-8d82-3223c16e44eb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:28.446596 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-146adfbc-571f-4d49-8d82-3223c16e44eb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:28.447983 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-146adfbc-571f-4d49-8d82-3223c16e44eb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1736 microversion: 2.20 time: 0.177421 Oct 28 12:36:28.459967 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 427/859] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:28 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1736 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:36:28.912680 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-1f6ecb65-d118-497e-ae3a-d7b1b0e695c1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:28.913696 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-1f6ecb65-d118-497e-ae3a-d7b1b0e695c1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:28.922893 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1f6ecb65-d118-497e-ae3a-d7b1b0e695c1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:28.923592 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1f6ecb65-d118-497e-ae3a-d7b1b0e695c1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:28.924384 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1f6ecb65-d118-497e-ae3a-d7b1b0e695c1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:28.924841 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1f6ecb65-d118-497e-ae3a-d7b1b0e695c1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:29.022009 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-1f6ecb65-d118-497e-ae3a-d7b1b0e695c1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 35250 microversion: 2.1 time: 0.113642 Oct 28 12:36:29.023657 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 433/860] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:36:28 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 35250 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:36:29.466353 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-01d96609-f9e4-47f9-ab23-22619ec337ab tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:29.467673 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-01d96609-f9e4-47f9-ab23-22619ec337ab tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:29.474409 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-01d96609-f9e4-47f9-ab23-22619ec337ab tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:29.474893 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-01d96609-f9e4-47f9-ab23-22619ec337ab tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:29.475671 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-01d96609-f9e4-47f9-ab23-22619ec337ab tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:29.476123 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-01d96609-f9e4-47f9-ab23-22619ec337ab tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:29.608334 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-01d96609-f9e4-47f9-ab23-22619ec337ab tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:29.616678 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-01d96609-f9e4-47f9-ab23-22619ec337ab tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:29.618187 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-01d96609-f9e4-47f9-ab23-22619ec337ab tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:29.619714 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-01d96609-f9e4-47f9-ab23-22619ec337ab tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1736 microversion: 2.20 time: 0.157115 Oct 28 12:36:29.620278 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 428/861] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:29 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:36:30.042309 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-107ab71e-3e12-4cef-9cbc-1bfda5b73577 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:30.043467 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-107ab71e-3e12-4cef-9cbc-1bfda5b73577 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:30.051238 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-107ab71e-3e12-4cef-9cbc-1bfda5b73577 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:30.051671 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-107ab71e-3e12-4cef-9cbc-1bfda5b73577 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:30.053565 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-107ab71e-3e12-4cef-9cbc-1bfda5b73577 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:30.054482 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-107ab71e-3e12-4cef-9cbc-1bfda5b73577 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:30.150818 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-107ab71e-3e12-4cef-9cbc-1bfda5b73577 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 36392 microversion: 2.1 time: 0.119328 Oct 28 12:36:30.151922 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 434/862] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:36:30 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 36392 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:36:30.640024 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-051b057a-16fd-4e6e-b476-6e1214d082d6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:30.640829 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-051b057a-16fd-4e6e-b476-6e1214d082d6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:30.654565 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-051b057a-16fd-4e6e-b476-6e1214d082d6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:30.655398 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-051b057a-16fd-4e6e-b476-6e1214d082d6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:30.657931 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-051b057a-16fd-4e6e-b476-6e1214d082d6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:30.659269 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-051b057a-16fd-4e6e-b476-6e1214d082d6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:30.813358 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-051b057a-16fd-4e6e-b476-6e1214d082d6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:30.829380 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-051b057a-16fd-4e6e-b476-6e1214d082d6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:30.831714 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-051b057a-16fd-4e6e-b476-6e1214d082d6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:30.833304 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-051b057a-16fd-4e6e-b476-6e1214d082d6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1736 microversion: 2.20 time: 0.199626 Oct 28 12:36:30.836097 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 429/863] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:30 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1736 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:36:31.173656 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-7093057d-5929-4675-8205-e28271bee63a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:31.176349 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-7093057d-5929-4675-8205-e28271bee63a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:31.193899 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7093057d-5929-4675-8205-e28271bee63a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:31.195078 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7093057d-5929-4675-8205-e28271bee63a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:31.196760 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7093057d-5929-4675-8205-e28271bee63a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:31.197755 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7093057d-5929-4675-8205-e28271bee63a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:31.321216 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-7093057d-5929-4675-8205-e28271bee63a tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 37777 microversion: 2.1 time: 0.158711 Oct 28 12:36:31.322703 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 435/864] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:36:31 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 37777 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:36:31.854004 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-818eab2c-a135-4719-bef9-f661d18f1201 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:31.855310 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-818eab2c-a135-4719-bef9-f661d18f1201 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:31.864398 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-818eab2c-a135-4719-bef9-f661d18f1201 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:31.864868 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-818eab2c-a135-4719-bef9-f661d18f1201 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:31.865624 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-818eab2c-a135-4719-bef9-f661d18f1201 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:31.866227 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-818eab2c-a135-4719-bef9-f661d18f1201 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:32.012280 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-818eab2c-a135-4719-bef9-f661d18f1201 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:32.020282 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-818eab2c-a135-4719-bef9-f661d18f1201 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:32.021773 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-818eab2c-a135-4719-bef9-f661d18f1201 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:32.022921 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-818eab2c-a135-4719-bef9-f661d18f1201 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1736 microversion: 2.20 time: 0.172891 Oct 28 12:36:32.023669 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 430/865] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:31 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:36:32.334405 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-139fd1f7-5e1c-4ff1-8085-41e97a9f57a4 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:32.335398 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-139fd1f7-5e1c-4ff1-8085-41e97a9f57a4 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:32.342653 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-139fd1f7-5e1c-4ff1-8085-41e97a9f57a4 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:32.343672 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-139fd1f7-5e1c-4ff1-8085-41e97a9f57a4 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:32.344688 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-139fd1f7-5e1c-4ff1-8085-41e97a9f57a4 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:32.345354 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-139fd1f7-5e1c-4ff1-8085-41e97a9f57a4 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:32.434226 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-139fd1f7-5e1c-4ff1-8085-41e97a9f57a4 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 38150 microversion: 2.1 time: 0.103655 Oct 28 12:36:32.435115 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 436/866] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:36:32 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 38150 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:36:33.041785 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-b58078c5-fe97-4f5d-b0fc-5eb6450dc7c3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:33.043049 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-b58078c5-fe97-4f5d-b0fc-5eb6450dc7c3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:33.049933 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b58078c5-fe97-4f5d-b0fc-5eb6450dc7c3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:33.050368 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b58078c5-fe97-4f5d-b0fc-5eb6450dc7c3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:33.051156 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b58078c5-fe97-4f5d-b0fc-5eb6450dc7c3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:33.051582 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b58078c5-fe97-4f5d-b0fc-5eb6450dc7c3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:33.212804 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-b58078c5-fe97-4f5d-b0fc-5eb6450dc7c3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:33.223397 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-b58078c5-fe97-4f5d-b0fc-5eb6450dc7c3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:33.225095 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-b58078c5-fe97-4f5d-b0fc-5eb6450dc7c3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:33.226359 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-b58078c5-fe97-4f5d-b0fc-5eb6450dc7c3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1736 microversion: 2.20 time: 0.188509 Oct 28 12:36:33.226932 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 431/867] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:33 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1736 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:36:33.447687 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-1fa7f2f0-b26e-448d-8c7b-36ba9dc70829 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:33.449478 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-1fa7f2f0-b26e-448d-8c7b-36ba9dc70829 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:33.461941 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1fa7f2f0-b26e-448d-8c7b-36ba9dc70829 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:33.462739 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1fa7f2f0-b26e-448d-8c7b-36ba9dc70829 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:33.463751 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1fa7f2f0-b26e-448d-8c7b-36ba9dc70829 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:33.464300 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1fa7f2f0-b26e-448d-8c7b-36ba9dc70829 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:33.533444 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-1fa7f2f0-b26e-448d-8c7b-36ba9dc70829 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 38150 microversion: 2.1 time: 0.089538 Oct 28 12:36:33.534469 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 437/868] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:36:33 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 38150 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:36:34.247118 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-5667c576-7373-48dd-ad4a-f99745ce4386 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:34.247701 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-5667c576-7373-48dd-ad4a-f99745ce4386 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:34.254746 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5667c576-7373-48dd-ad4a-f99745ce4386 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:34.255192 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5667c576-7373-48dd-ad4a-f99745ce4386 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:34.255975 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5667c576-7373-48dd-ad4a-f99745ce4386 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:34.256402 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5667c576-7373-48dd-ad4a-f99745ce4386 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:34.401590 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-5667c576-7373-48dd-ad4a-f99745ce4386 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:34.414612 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-5667c576-7373-48dd-ad4a-f99745ce4386 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:34.418665 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-5667c576-7373-48dd-ad4a-f99745ce4386 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:34.420075 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-5667c576-7373-48dd-ad4a-f99745ce4386 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1736 microversion: 2.20 time: 0.176916 Oct 28 12:36:34.431155 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 432/869] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:34 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:36:34.547363 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-b354a906-1dc7-41d2-a74e-cadec6ae43df tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:34.548416 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-b354a906-1dc7-41d2-a74e-cadec6ae43df tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:34.556852 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b354a906-1dc7-41d2-a74e-cadec6ae43df tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:34.557573 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b354a906-1dc7-41d2-a74e-cadec6ae43df tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:34.558351 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b354a906-1dc7-41d2-a74e-cadec6ae43df tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:34.558812 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b354a906-1dc7-41d2-a74e-cadec6ae43df tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:34.635691 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-b354a906-1dc7-41d2-a74e-cadec6ae43df tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 38150 microversion: 2.1 time: 0.092652 Oct 28 12:36:34.637905 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 438/870] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:36:34 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 38150 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:36:35.438735 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-4d2a9a24-1a0e-466c-b482-523b37a3ee58 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:35.439330 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-4d2a9a24-1a0e-466c-b482-523b37a3ee58 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:35.445997 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4d2a9a24-1a0e-466c-b482-523b37a3ee58 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:35.446650 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4d2a9a24-1a0e-466c-b482-523b37a3ee58 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:35.447650 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4d2a9a24-1a0e-466c-b482-523b37a3ee58 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:35.448076 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4d2a9a24-1a0e-466c-b482-523b37a3ee58 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:35.614344 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-4d2a9a24-1a0e-466c-b482-523b37a3ee58 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:35.622268 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-4d2a9a24-1a0e-466c-b482-523b37a3ee58 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:35.623804 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-4d2a9a24-1a0e-466c-b482-523b37a3ee58 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:35.624980 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-4d2a9a24-1a0e-466c-b482-523b37a3ee58 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1736 microversion: 2.20 time: 0.190012 Oct 28 12:36:35.625539 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 433/871] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:35 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:36:35.649800 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-199df13a-e794-4d9f-a504-29ce1a55cf20 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:35.650780 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-199df13a-e794-4d9f-a504-29ce1a55cf20 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:35.658025 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-199df13a-e794-4d9f-a504-29ce1a55cf20 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:35.658453 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-199df13a-e794-4d9f-a504-29ce1a55cf20 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:35.659265 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-199df13a-e794-4d9f-a504-29ce1a55cf20 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:35.659679 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-199df13a-e794-4d9f-a504-29ce1a55cf20 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:35.733244 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-199df13a-e794-4d9f-a504-29ce1a55cf20 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 38152 microversion: 2.1 time: 0.087188 Oct 28 12:36:35.733878 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 439/872] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:36:35 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 38152 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:36:36.643611 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-64a2c991-7c13-48da-9023-6b5fa9bc1e20 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:36.644336 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-64a2c991-7c13-48da-9023-6b5fa9bc1e20 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:36.650772 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-64a2c991-7c13-48da-9023-6b5fa9bc1e20 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:36.651219 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-64a2c991-7c13-48da-9023-6b5fa9bc1e20 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:36.651993 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-64a2c991-7c13-48da-9023-6b5fa9bc1e20 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:36.652462 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-64a2c991-7c13-48da-9023-6b5fa9bc1e20 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:36.745291 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-98f31d04-5c04-4268-bfd2-9dc498d5ea76 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:36.746290 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-98f31d04-5c04-4268-bfd2-9dc498d5ea76 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:36.753332 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-98f31d04-5c04-4268-bfd2-9dc498d5ea76 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:36.753774 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-98f31d04-5c04-4268-bfd2-9dc498d5ea76 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:36.754549 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-98f31d04-5c04-4268-bfd2-9dc498d5ea76 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:36.754977 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-98f31d04-5c04-4268-bfd2-9dc498d5ea76 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:36.775751 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-64a2c991-7c13-48da-9023-6b5fa9bc1e20 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:36.783807 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-64a2c991-7c13-48da-9023-6b5fa9bc1e20 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:36.785358 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-64a2c991-7c13-48da-9023-6b5fa9bc1e20 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:36.786497 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-64a2c991-7c13-48da-9023-6b5fa9bc1e20 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1718 microversion: 2.20 time: 0.146813 Oct 28 12:36:36.787059 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 434/873] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:36 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:36:36.841901 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-98f31d04-5c04-4268-bfd2-9dc498d5ea76 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action" status: 200 len: 38277 microversion: 2.1 time: 0.100533 Oct 28 12:36:36.842560 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 440/874] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:36:36 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/action => generated 38277 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:36:36.852578 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-10a3492a-cb9e-4ca7-9549-78d1d76cc066 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:36.853095 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-10a3492a-cb9e-4ca7-9549-78d1d76cc066 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:36.859565 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-10a3492a-cb9e-4ca7-9549-78d1d76cc066 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:36.860137 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-10a3492a-cb9e-4ca7-9549-78d1d76cc066 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:36.861292 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-10a3492a-cb9e-4ca7-9549-78d1d76cc066 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:36.862031 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-10a3492a-cb9e-4ca7-9549-78d1d76cc066 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:36.886515 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-10a3492a-cb9e-4ca7-9549-78d1d76cc066 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/ips" status: 200 len: 145 microversion: 2.1 time: 0.037679 Oct 28 12:36:36.887077 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 435/875] 10.222.0.62 () {58 vars in 1247 bytes} [Thu Oct 28 12:36:36 2021] GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:36:37.806253 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-22940fa9-e300-475e-9bd9-b188b486d335 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:37.806968 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-22940fa9-e300-475e-9bd9-b188b486d335 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:37.814280 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-22940fa9-e300-475e-9bd9-b188b486d335 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:37.814718 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-22940fa9-e300-475e-9bd9-b188b486d335 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:37.815478 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-22940fa9-e300-475e-9bd9-b188b486d335 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:37.815897 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-22940fa9-e300-475e-9bd9-b188b486d335 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:37.945578 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-22940fa9-e300-475e-9bd9-b188b486d335 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:37.954067 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-22940fa9-e300-475e-9bd9-b188b486d335 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:37.955548 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-22940fa9-e300-475e-9bd9-b188b486d335 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:37.956754 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-22940fa9-e300-475e-9bd9-b188b486d335 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1718 microversion: 2.20 time: 0.155006 Oct 28 12:36:37.957314 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 441/876] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:37 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:36:38.203414 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-1dacf46b-ef20-420b-a666-48c2102896aa tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c96029d-a281-457f-bfd3-4b82e3506699"}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:38.204527 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-1dacf46b-ef20-420b-a666-48c2102896aa tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:38.212032 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1dacf46b-ef20-420b-a666-48c2102896aa tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:38.212477 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1dacf46b-ef20-420b-a666-48c2102896aa tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:38.213279 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1dacf46b-ef20-420b-a666-48c2102896aa tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:38.213707 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1dacf46b-ef20-420b-a666-48c2102896aa tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:38.454839 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-1dacf46b-ef20-420b-a666-48c2102896aa tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255392 Oct 28 12:36:38.455665 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 436/877] 10.222.0.62 () {60 vars in 1322 bytes} [Thu Oct 28 12:36:38 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:36:38.949067 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-e0398cc6-c7f6-41e7-aaf3-c112b2cf90b7 req-6a4cc422-2821-4ff8-815f-42d65f694744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726", "name": "network-vif-unplugged", "status": "completed", "tag": "c25d48e4-43fb-464d-a891-6f40b7296a25"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:38.950716 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:36:38.950716 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:36:38.958702 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-e0398cc6-c7f6-41e7-aaf3-c112b2cf90b7 req-6a4cc422-2821-4ff8-815f-42d65f694744 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:38.959271 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-e0398cc6-c7f6-41e7-aaf3-c112b2cf90b7 req-6a4cc422-2821-4ff8-815f-42d65f694744 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:38.970513 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.compute.server_external_events [req-e0398cc6-c7f6-41e7-aaf3-c112b2cf90b7 req-6a4cc422-2821-4ff8-815f-42d65f694744 service nova] Unable to find a host for instance c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726. Dropping event network-vif-unplugged {{(pid=115876) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Oct 28 12:36:38.971383 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-e0398cc6-c7f6-41e7-aaf3-c112b2cf90b7 req-6a4cc422-2821-4ff8-815f-42d65f694744 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026103 Oct 28 12:36:38.971983 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 442/878] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:36:38 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 28 12:36:38.975855 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-64b80382-3b6b-408a-825e-71465f5f810c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:38.976562 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-64b80382-3b6b-408a-825e-71465f5f810c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:38.984806 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-64b80382-3b6b-408a-825e-71465f5f810c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:38.985261 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-64b80382-3b6b-408a-825e-71465f5f810c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:38.986038 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-64b80382-3b6b-408a-825e-71465f5f810c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:38.986468 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-64b80382-3b6b-408a-825e-71465f5f810c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:39.112011 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-64b80382-3b6b-408a-825e-71465f5f810c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:39.120219 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-64b80382-3b6b-408a-825e-71465f5f810c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:39.121710 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-64b80382-3b6b-408a-825e-71465f5f810c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:39.122891 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-64b80382-3b6b-408a-825e-71465f5f810c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1661 microversion: 2.20 time: 0.152267 Oct 28 12:36:39.123539 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 437/879] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:38 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1661 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:36:39.141750 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-5778ca09-44ec-4166-9e1d-d8034c9ff571 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9cff983-c8ec-4128-a09d-74a453490076"}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:39.142820 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-5778ca09-44ec-4166-9e1d-d8034c9ff571 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:39.149374 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5778ca09-44ec-4166-9e1d-d8034c9ff571 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:39.149746 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5778ca09-44ec-4166-9e1d-d8034c9ff571 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:39.150525 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5778ca09-44ec-4166-9e1d-d8034c9ff571 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:39.150984 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5778ca09-44ec-4166-9e1d-d8034c9ff571 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:39.416132 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-5778ca09-44ec-4166-9e1d-d8034c9ff571 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.278323 Oct 28 12:36:39.416744 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 443/880] 10.222.0.62 () {62 vars in 1363 bytes} [Thu Oct 28 12:36:39 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/os-volume_attachments => generated 188 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:36:39.528048 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-f7cdc0a9-3c22-4cb5-b63a-d3d8b570d038 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:39.529712 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-f7cdc0a9-3c22-4cb5-b63a-d3d8b570d038 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:39.537273 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f7cdc0a9-3c22-4cb5-b63a-d3d8b570d038 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:39.537897 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f7cdc0a9-3c22-4cb5-b63a-d3d8b570d038 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:39.538767 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f7cdc0a9-3c22-4cb5-b63a-d3d8b570d038 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:39.539368 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-f7cdc0a9-3c22-4cb5-b63a-d3d8b570d038 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:39.814406 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-f7cdc0a9-3c22-4cb5-b63a-d3d8b570d038 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/os-volume_attachments/d9cff983-c8ec-4128-a09d-74a453490076" status: 202 len: 0 microversion: 2.20 time: 0.290308 Oct 28 12:36:39.815085 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 438/881] 10.222.0.62 () {60 vars in 1456 bytes} [Thu Oct 28 12:36:39 2021] DELETE /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/os-volume_attachments/d9cff983-c8ec-4128-a09d-74a453490076 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:36:39.870412 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-aa5da2c8-9edc-4712-857d-0372eda36e9a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:39.871183 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-aa5da2c8-9edc-4712-857d-0372eda36e9a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:39.877991 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-aa5da2c8-9edc-4712-857d-0372eda36e9a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:39.878431 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-aa5da2c8-9edc-4712-857d-0372eda36e9a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:39.879185 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-aa5da2c8-9edc-4712-857d-0372eda36e9a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:39.879609 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-aa5da2c8-9edc-4712-857d-0372eda36e9a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:40.094726 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-aa5da2c8-9edc-4712-857d-0372eda36e9a tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action" status: 202 len: 0 microversion: 2.20 time: 0.228300 Oct 28 12:36:40.095418 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 444/882] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Oct 28 12:36:39 2021] POST /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:36:40.103192 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-5d6b18a3-abc9-43a0-ba4b-e6f1271068c3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:40.103916 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-5d6b18a3-abc9-43a0-ba4b-e6f1271068c3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:40.111409 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5d6b18a3-abc9-43a0-ba4b-e6f1271068c3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:40.111938 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5d6b18a3-abc9-43a0-ba4b-e6f1271068c3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:40.112808 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5d6b18a3-abc9-43a0-ba4b-e6f1271068c3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:40.113317 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5d6b18a3-abc9-43a0-ba4b-e6f1271068c3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:40.237628 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-5d6b18a3-abc9-43a0-ba4b-e6f1271068c3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:40.245458 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-5d6b18a3-abc9-43a0-ba4b-e6f1271068c3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:40.246940 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-5d6b18a3-abc9-43a0-ba4b-e6f1271068c3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:40.248099 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-5d6b18a3-abc9-43a0-ba4b-e6f1271068c3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1669 microversion: 2.20 time: 0.148629 Oct 28 12:36:40.248772 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 439/883] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:40 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1669 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:36:41.267430 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-63087c8d-7bca-4ca0-a8bd-9f8c42e67f35 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:41.268059 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-63087c8d-7bca-4ca0-a8bd-9f8c42e67f35 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:41.274033 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-63087c8d-7bca-4ca0-a8bd-9f8c42e67f35 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:41.274467 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-63087c8d-7bca-4ca0-a8bd-9f8c42e67f35 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:41.275254 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-63087c8d-7bca-4ca0-a8bd-9f8c42e67f35 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:41.275667 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-63087c8d-7bca-4ca0-a8bd-9f8c42e67f35 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:41.401242 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-63087c8d-7bca-4ca0-a8bd-9f8c42e67f35 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:41.409555 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-63087c8d-7bca-4ca0-a8bd-9f8c42e67f35 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:41.411038 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-63087c8d-7bca-4ca0-a8bd-9f8c42e67f35 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:41.412202 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-63087c8d-7bca-4ca0-a8bd-9f8c42e67f35 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1669 microversion: 2.20 time: 0.149428 Oct 28 12:36:41.412842 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 445/884] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:41 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1669 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:36:42.431810 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-947a3a53-5b47-4021-8bb3-5e223a76f053 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:42.432371 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-947a3a53-5b47-4021-8bb3-5e223a76f053 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:42.439345 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-947a3a53-5b47-4021-8bb3-5e223a76f053 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:42.439788 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-947a3a53-5b47-4021-8bb3-5e223a76f053 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:42.440564 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-947a3a53-5b47-4021-8bb3-5e223a76f053 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:42.441017 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-947a3a53-5b47-4021-8bb3-5e223a76f053 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:42.568699 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-947a3a53-5b47-4021-8bb3-5e223a76f053 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:42.578246 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-947a3a53-5b47-4021-8bb3-5e223a76f053 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:42.579952 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-947a3a53-5b47-4021-8bb3-5e223a76f053 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:42.581370 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-947a3a53-5b47-4021-8bb3-5e223a76f053 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1669 microversion: 2.20 time: 0.154250 Oct 28 12:36:42.581932 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 440/885] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:42 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1669 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:36:43.599781 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-6e652fd5-7ba6-4d5c-9e46-88882eece406 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:43.600420 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-6e652fd5-7ba6-4d5c-9e46-88882eece406 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:43.607232 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6e652fd5-7ba6-4d5c-9e46-88882eece406 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:43.607678 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6e652fd5-7ba6-4d5c-9e46-88882eece406 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:43.608487 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6e652fd5-7ba6-4d5c-9e46-88882eece406 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:43.608950 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6e652fd5-7ba6-4d5c-9e46-88882eece406 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:43.808692 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-6e652fd5-7ba6-4d5c-9e46-88882eece406 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:43.817935 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-6e652fd5-7ba6-4d5c-9e46-88882eece406 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:43.819487 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-6e652fd5-7ba6-4d5c-9e46-88882eece406 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:43.820647 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-6e652fd5-7ba6-4d5c-9e46-88882eece406 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1727 microversion: 2.20 time: 0.224850 Oct 28 12:36:43.821229 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 446/886] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:43 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1727 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:36:44.844391 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-da7ada4c-e97c-4c93-9266-a4223f38f37f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:44.844993 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-da7ada4c-e97c-4c93-9266-a4223f38f37f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:44.859810 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-da7ada4c-e97c-4c93-9266-a4223f38f37f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:44.860492 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-da7ada4c-e97c-4c93-9266-a4223f38f37f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:44.861890 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-da7ada4c-e97c-4c93-9266-a4223f38f37f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:44.862561 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-da7ada4c-e97c-4c93-9266-a4223f38f37f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:45.048068 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-da7ada4c-e97c-4c93-9266-a4223f38f37f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:45.058403 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-da7ada4c-e97c-4c93-9266-a4223f38f37f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:45.060052 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-da7ada4c-e97c-4c93-9266-a4223f38f37f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:45.061355 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-da7ada4c-e97c-4c93-9266-a4223f38f37f tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1727 microversion: 2.20 time: 0.222070 Oct 28 12:36:45.062093 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 441/887] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:44 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1727 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:36:45.976598 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-994eaa3c-305b-4f69-ac07-9258b91de6a4 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:45.977593 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-994eaa3c-305b-4f69-ac07-9258b91de6a4 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:45.984139 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-994eaa3c-305b-4f69-ac07-9258b91de6a4 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:45.984579 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-994eaa3c-305b-4f69-ac07-9258b91de6a4 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:45.985388 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-994eaa3c-305b-4f69-ac07-9258b91de6a4 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:45.985812 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-994eaa3c-305b-4f69-ac07-9258b91de6a4 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:46.020140 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-994eaa3c-305b-4f69-ac07-9258b91de6a4 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048168 Oct 28 12:36:46.020708 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 447/888] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Oct 28 12:36:45 2021] GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:36:46.030626 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-ab545221-4693-49b5-8343-b80e6f36a942 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:46.031299 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-ab545221-4693-49b5-8343-b80e6f36a942 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:46.038652 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ab545221-4693-49b5-8343-b80e6f36a942 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:46.039167 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ab545221-4693-49b5-8343-b80e6f36a942 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:46.040108 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ab545221-4693-49b5-8343-b80e6f36a942 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:46.040538 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ab545221-4693-49b5-8343-b80e6f36a942 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:46.079782 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-4cad5a24-7c19-4a13-a959-ec515eda0fb3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:46.080380 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-4cad5a24-7c19-4a13-a959-ec515eda0fb3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:46.081987 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-ab545221-4693-49b5-8343-b80e6f36a942 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/os-volume_attachments/8c96029d-a281-457f-bfd3-4b82e3506699" status: 200 len: 194 microversion: 2.1 time: 0.055271 Oct 28 12:36:46.082608 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 442/889] 10.222.0.62 () {58 vars in 1412 bytes} [Thu Oct 28 12:36:46 2021] GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/os-volume_attachments/8c96029d-a281-457f-bfd3-4b82e3506699 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:36:46.086804 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4cad5a24-7c19-4a13-a959-ec515eda0fb3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:46.087243 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4cad5a24-7c19-4a13-a959-ec515eda0fb3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:46.088015 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4cad5a24-7c19-4a13-a959-ec515eda0fb3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:46.088801 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4cad5a24-7c19-4a13-a959-ec515eda0fb3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:46.229451 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-4cad5a24-7c19-4a13-a959-ec515eda0fb3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:46.239532 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-4cad5a24-7c19-4a13-a959-ec515eda0fb3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:46.241312 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-4cad5a24-7c19-4a13-a959-ec515eda0fb3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:46.242658 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-4cad5a24-7c19-4a13-a959-ec515eda0fb3 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1727 microversion: 2.20 time: 0.166760 Oct 28 12:36:46.243720 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 448/890] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:46 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:36:47.265251 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-01071d16-14bf-484b-ac39-c7b1a6a54e04 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:47.266017 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-01071d16-14bf-484b-ac39-c7b1a6a54e04 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:47.273118 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-01071d16-14bf-484b-ac39-c7b1a6a54e04 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:47.273570 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-01071d16-14bf-484b-ac39-c7b1a6a54e04 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:47.274351 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-01071d16-14bf-484b-ac39-c7b1a6a54e04 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:47.274779 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-01071d16-14bf-484b-ac39-c7b1a6a54e04 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:47.421245 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-01071d16-14bf-484b-ac39-c7b1a6a54e04 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:47.433929 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-01071d16-14bf-484b-ac39-c7b1a6a54e04 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:47.435553 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-01071d16-14bf-484b-ac39-c7b1a6a54e04 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:47.436904 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-01071d16-14bf-484b-ac39-c7b1a6a54e04 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1727 microversion: 2.20 time: 0.175437 Oct 28 12:36:47.438047 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 443/891] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:47 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:36:47.439878 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-ebb641bd-b4b1-447c-83d3-0e4dca5be927 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99b1d23d-17ce-40a7-bf00-28ae51c6d319"}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:36:47.440964 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-ebb641bd-b4b1-447c-83d3-0e4dca5be927 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:47.448507 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ebb641bd-b4b1-447c-83d3-0e4dca5be927 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:47.449212 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ebb641bd-b4b1-447c-83d3-0e4dca5be927 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:47.449982 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ebb641bd-b4b1-447c-83d3-0e4dca5be927 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:47.450399 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ebb641bd-b4b1-447c-83d3-0e4dca5be927 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:48.455610 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-262ad91a-fa53-4c65-b32e-783f6c88ede5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:48.456267 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-262ad91a-fa53-4c65-b32e-783f6c88ede5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:48.462885 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-262ad91a-fa53-4c65-b32e-783f6c88ede5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:48.463329 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-262ad91a-fa53-4c65-b32e-783f6c88ede5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:48.464105 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-262ad91a-fa53-4c65-b32e-783f6c88ede5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:48.464531 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-262ad91a-fa53-4c65-b32e-783f6c88ede5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:48.606359 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-262ad91a-fa53-4c65-b32e-783f6c88ede5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:48.616021 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-262ad91a-fa53-4c65-b32e-783f6c88ede5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:48.617540 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-262ad91a-fa53-4c65-b32e-783f6c88ede5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:48.618707 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-262ad91a-fa53-4c65-b32e-783f6c88ede5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1727 microversion: 2.20 time: 0.167022 Oct 28 12:36:48.619276 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 444/892] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:48 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:36:49.636206 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-65debfeb-8569-45b9-96ed-72ed8d8e72b1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:49.636972 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-65debfeb-8569-45b9-96ed-72ed8d8e72b1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:49.643561 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-65debfeb-8569-45b9-96ed-72ed8d8e72b1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:49.644008 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-65debfeb-8569-45b9-96ed-72ed8d8e72b1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:49.644794 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-65debfeb-8569-45b9-96ed-72ed8d8e72b1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:49.645256 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-65debfeb-8569-45b9-96ed-72ed8d8e72b1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:49.777048 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-65debfeb-8569-45b9-96ed-72ed8d8e72b1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:49.785266 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-65debfeb-8569-45b9-96ed-72ed8d8e72b1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:49.787105 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-65debfeb-8569-45b9-96ed-72ed8d8e72b1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:49.788409 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-65debfeb-8569-45b9-96ed-72ed8d8e72b1 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1727 microversion: 2.20 time: 0.156001 Oct 28 12:36:49.789086 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 445/893] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:49 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:36:50.807156 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-05a786e1-eb82-420b-93e0-97e54152a5a8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:50.807868 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-05a786e1-eb82-420b-93e0-97e54152a5a8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:50.814806 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-05a786e1-eb82-420b-93e0-97e54152a5a8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:50.815248 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-05a786e1-eb82-420b-93e0-97e54152a5a8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:50.815961 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-05a786e1-eb82-420b-93e0-97e54152a5a8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:50.816373 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-05a786e1-eb82-420b-93e0-97e54152a5a8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:50.957006 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-05a786e1-eb82-420b-93e0-97e54152a5a8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:50.965579 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-05a786e1-eb82-420b-93e0-97e54152a5a8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:50.967120 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-05a786e1-eb82-420b-93e0-97e54152a5a8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:50.968345 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-05a786e1-eb82-420b-93e0-97e54152a5a8 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1727 microversion: 2.20 time: 0.164932 Oct 28 12:36:50.968943 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 446/894] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:50 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:36:51.986571 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-57bbe59f-c97a-4d70-9ef8-dba9b66517e5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:51.987436 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-57bbe59f-c97a-4d70-9ef8-dba9b66517e5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:51.994526 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-57bbe59f-c97a-4d70-9ef8-dba9b66517e5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:51.994960 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-57bbe59f-c97a-4d70-9ef8-dba9b66517e5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:51.995736 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-57bbe59f-c97a-4d70-9ef8-dba9b66517e5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:51.996151 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-57bbe59f-c97a-4d70-9ef8-dba9b66517e5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:52.131171 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-57bbe59f-c97a-4d70-9ef8-dba9b66517e5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:52.139172 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-57bbe59f-c97a-4d70-9ef8-dba9b66517e5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:52.140657 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-57bbe59f-c97a-4d70-9ef8-dba9b66517e5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:52.141842 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-57bbe59f-c97a-4d70-9ef8-dba9b66517e5 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1727 microversion: 2.20 time: 0.159342 Oct 28 12:36:52.142640 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 447/895] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:51 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:36:53.159514 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-6549d090-e667-4586-8b18-68020dc8b63b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:53.160067 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-6549d090-e667-4586-8b18-68020dc8b63b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:53.166873 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6549d090-e667-4586-8b18-68020dc8b63b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:53.167529 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6549d090-e667-4586-8b18-68020dc8b63b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:53.168149 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6549d090-e667-4586-8b18-68020dc8b63b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:53.168580 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-6549d090-e667-4586-8b18-68020dc8b63b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:53.307625 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-6549d090-e667-4586-8b18-68020dc8b63b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:53.316496 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-6549d090-e667-4586-8b18-68020dc8b63b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:53.318123 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-6549d090-e667-4586-8b18-68020dc8b63b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:53.319290 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-6549d090-e667-4586-8b18-68020dc8b63b tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1727 microversion: 2.20 time: 0.163686 Oct 28 12:36:53.319853 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 448/896] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:53 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:36:54.337781 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-bb9936b3-ee38-4531-910f-960ad6889a60 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:54.338471 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-bb9936b3-ee38-4531-910f-960ad6889a60 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:54.345494 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-bb9936b3-ee38-4531-910f-960ad6889a60 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:54.346092 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-bb9936b3-ee38-4531-910f-960ad6889a60 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:54.347135 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-bb9936b3-ee38-4531-910f-960ad6889a60 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:54.347716 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-bb9936b3-ee38-4531-910f-960ad6889a60 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:54.480220 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-bb9936b3-ee38-4531-910f-960ad6889a60 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:54.489387 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-bb9936b3-ee38-4531-910f-960ad6889a60 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:54.491190 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-bb9936b3-ee38-4531-910f-960ad6889a60 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:54.492632 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-bb9936b3-ee38-4531-910f-960ad6889a60 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1727 microversion: 2.20 time: 0.158954 Oct 28 12:36:54.493341 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 449/897] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:54 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:36:55.512751 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-b8abac72-c67d-4224-afbd-e212572087c0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:55.513542 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-b8abac72-c67d-4224-afbd-e212572087c0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:55.522331 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b8abac72-c67d-4224-afbd-e212572087c0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:55.523186 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b8abac72-c67d-4224-afbd-e212572087c0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:55.524324 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b8abac72-c67d-4224-afbd-e212572087c0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:55.525088 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b8abac72-c67d-4224-afbd-e212572087c0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:55.663182 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-b8abac72-c67d-4224-afbd-e212572087c0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:55.672556 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-b8abac72-c67d-4224-afbd-e212572087c0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:55.674139 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-b8abac72-c67d-4224-afbd-e212572087c0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:55.675301 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-b8abac72-c67d-4224-afbd-e212572087c0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1727 microversion: 2.20 time: 0.167146 Oct 28 12:36:55.676071 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 450/898] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:55 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:36:56.694397 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-2603ebdb-86c2-4373-9356-43baccd946ee tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:56.695196 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-2603ebdb-86c2-4373-9356-43baccd946ee tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:56.701827 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2603ebdb-86c2-4373-9356-43baccd946ee tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:56.702277 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2603ebdb-86c2-4373-9356-43baccd946ee tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:56.703113 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2603ebdb-86c2-4373-9356-43baccd946ee tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:56.703512 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2603ebdb-86c2-4373-9356-43baccd946ee tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:56.835178 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-2603ebdb-86c2-4373-9356-43baccd946ee tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:56.845201 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-2603ebdb-86c2-4373-9356-43baccd946ee tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:56.846723 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-2603ebdb-86c2-4373-9356-43baccd946ee tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:56.848012 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-2603ebdb-86c2-4373-9356-43baccd946ee tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1727 microversion: 2.20 time: 0.157676 Oct 28 12:36:56.848574 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 451/899] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:56 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:36:57.366489 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-ebb641bd-b4b1-447c-83d3-0e4dca5be927 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.931068 Oct 28 12:36:57.367929 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 449/900] 10.222.0.62 () {60 vars in 1322 bytes} [Thu Oct 28 12:36:47 2021] POST /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/os-volume_attachments => generated 194 bytes in 9933 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:36:57.866501 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-02507fed-0424-447e-910b-091cc19fc66c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:57.867184 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-02507fed-0424-447e-910b-091cc19fc66c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:57.874021 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-02507fed-0424-447e-910b-091cc19fc66c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:57.874500 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-02507fed-0424-447e-910b-091cc19fc66c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:57.875281 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-02507fed-0424-447e-910b-091cc19fc66c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:57.875729 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-02507fed-0424-447e-910b-091cc19fc66c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:58.005518 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-02507fed-0424-447e-910b-091cc19fc66c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:58.014172 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-02507fed-0424-447e-910b-091cc19fc66c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:58.015674 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-02507fed-0424-447e-910b-091cc19fc66c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:58.016853 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-02507fed-0424-447e-910b-091cc19fc66c tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1727 microversion: 2.20 time: 0.154219 Oct 28 12:36:58.017419 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 452/901] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:57 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:36:59.036248 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-eb38854a-6fe2-4cc9-a983-39b22c0274c7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:36:59.037005 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-eb38854a-6fe2-4cc9-a983-39b22c0274c7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:36:59.044059 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-eb38854a-6fe2-4cc9-a983-39b22c0274c7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:59.044506 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-eb38854a-6fe2-4cc9-a983-39b22c0274c7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:59.045295 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-eb38854a-6fe2-4cc9-a983-39b22c0274c7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:36:59.045719 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-eb38854a-6fe2-4cc9-a983-39b22c0274c7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:36:59.204215 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-eb38854a-6fe2-4cc9-a983-39b22c0274c7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:59.213141 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-eb38854a-6fe2-4cc9-a983-39b22c0274c7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:59.214602 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-eb38854a-6fe2-4cc9-a983-39b22c0274c7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:36:59.215756 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-eb38854a-6fe2-4cc9-a983-39b22c0274c7 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1727 microversion: 2.20 time: 0.184140 Oct 28 12:36:59.216343 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 450/902] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:36:59 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1727 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:37:00.234745 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-3ac5164d-6146-4efd-8336-b6336e7b4e57 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:00.235360 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-3ac5164d-6146-4efd-8336-b6336e7b4e57 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:37:00.242011 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3ac5164d-6146-4efd-8336-b6336e7b4e57 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:00.242452 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3ac5164d-6146-4efd-8336-b6336e7b4e57 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:00.243217 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3ac5164d-6146-4efd-8336-b6336e7b4e57 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:00.243643 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3ac5164d-6146-4efd-8336-b6336e7b4e57 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:00.384951 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-3ac5164d-6146-4efd-8336-b6336e7b4e57 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:37:00.396147 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-3ac5164d-6146-4efd-8336-b6336e7b4e57 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:37:00.397695 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-3ac5164d-6146-4efd-8336-b6336e7b4e57 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:37:00.398867 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-3ac5164d-6146-4efd-8336-b6336e7b4e57 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1727 microversion: 2.20 time: 0.168066 Oct 28 12:37:00.399417 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 453/903] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:37:00 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:37:01.404681 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-f7cb9901-bac3-4d07-a848-a8510586c09c req-738a2037-3e3c-4b05-8a52-53662c797676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726", "name": "network-vif-plugged", "status": "completed", "tag": "c25d48e4-43fb-464d-a891-6f40b7296a25"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:37:01.406348 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:37:01.406348 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:37:01.415708 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-f7cb9901-bac3-4d07-a848-a8510586c09c req-738a2037-3e3c-4b05-8a52-53662c797676 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:01.416197 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-f7cb9901-bac3-4d07-a848-a8510586c09c req-738a2037-3e3c-4b05-8a52-53662c797676 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:01.417955 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-56132502-031c-4f6c-9acd-cacf9c8102f6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:01.418763 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-56132502-031c-4f6c-9acd-cacf9c8102f6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:37:01.427165 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-56132502-031c-4f6c-9acd-cacf9c8102f6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:01.427709 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-56132502-031c-4f6c-9acd-cacf9c8102f6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:01.428479 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-56132502-031c-4f6c-9acd-cacf9c8102f6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:01.428593 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-f7cb9901-bac3-4d07-a848-a8510586c09c req-738a2037-3e3c-4b05-8a52-53662c797676 service nova] Creating event network-vif-plugged:c25d48e4-43fb-464d-a891-6f40b7296a25 for instance c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 on hv-cinder-81514 Oct 28 12:37:01.428941 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-56132502-031c-4f6c-9acd-cacf9c8102f6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:01.433651 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-f7cb9901-bac3-4d07-a848-a8510586c09c req-738a2037-3e3c-4b05-8a52-53662c797676 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032737 Oct 28 12:37:01.434280 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 451/904] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:37:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:37:01.568400 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-56132502-031c-4f6c-9acd-cacf9c8102f6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:37:01.576667 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-56132502-031c-4f6c-9acd-cacf9c8102f6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:37:01.578452 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-56132502-031c-4f6c-9acd-cacf9c8102f6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:37:01.579648 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-56132502-031c-4f6c-9acd-cacf9c8102f6 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1727 microversion: 2.20 time: 0.166784 Oct 28 12:37:01.580206 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 454/905] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:37:01 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:37:02.599590 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-e8e134cb-e410-48f3-833f-e25ed3544b29 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:02.600315 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-e8e134cb-e410-48f3-833f-e25ed3544b29 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:37:02.607018 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e8e134cb-e410-48f3-833f-e25ed3544b29 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:02.607447 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e8e134cb-e410-48f3-833f-e25ed3544b29 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:02.608198 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e8e134cb-e410-48f3-833f-e25ed3544b29 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:02.608615 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e8e134cb-e410-48f3-833f-e25ed3544b29 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:02.758653 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-e8e134cb-e410-48f3-833f-e25ed3544b29 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:37:02.772035 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-e8e134cb-e410-48f3-833f-e25ed3544b29 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:37:02.774044 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-e8e134cb-e410-48f3-833f-e25ed3544b29 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:37:02.775342 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-e8e134cb-e410-48f3-833f-e25ed3544b29 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1727 microversion: 2.20 time: 0.180804 Oct 28 12:37:02.776174 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 452/906] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:37:02 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1727 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:37:03.795901 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-222956b1-8e54-4d9b-8e71-b28785dbc613 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:03.796610 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-222956b1-8e54-4d9b-8e71-b28785dbc613 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:37:03.805484 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-222956b1-8e54-4d9b-8e71-b28785dbc613 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:03.806006 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-222956b1-8e54-4d9b-8e71-b28785dbc613 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:03.806825 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-222956b1-8e54-4d9b-8e71-b28785dbc613 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:03.807290 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-222956b1-8e54-4d9b-8e71-b28785dbc613 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:03.973419 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-222956b1-8e54-4d9b-8e71-b28785dbc613 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:37:03.983653 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-222956b1-8e54-4d9b-8e71-b28785dbc613 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:37:03.985178 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-222956b1-8e54-4d9b-8e71-b28785dbc613 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:37:03.986401 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-222956b1-8e54-4d9b-8e71-b28785dbc613 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1714 microversion: 2.20 time: 0.194849 Oct 28 12:37:03.986983 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 455/907] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:37:03 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1714 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:37:04.881901 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-5508824e-d88f-46af-aaaa-e3c39f16d406 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:04.882975 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-5508824e-d88f-46af-aaaa-e3c39f16d406 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:37:04.889475 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5508824e-d88f-46af-aaaa-e3c39f16d406 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:04.889912 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5508824e-d88f-46af-aaaa-e3c39f16d406 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:04.890842 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5508824e-d88f-46af-aaaa-e3c39f16d406 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:04.891269 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-5508824e-d88f-46af-aaaa-e3c39f16d406 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:04.929339 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-5508824e-d88f-46af-aaaa-e3c39f16d406 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051224 Oct 28 12:37:04.930318 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 453/908] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Oct 28 12:37:04 2021] GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:37:05.175236 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-5ac6e11f-edfe-49c3-978d-19e1f3709d7f tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:05.175802 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-5ac6e11f-edfe-49c3-978d-19e1f3709d7f tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:37:05.182837 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5ac6e11f-edfe-49c3-978d-19e1f3709d7f tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:05.183280 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5ac6e11f-edfe-49c3-978d-19e1f3709d7f tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:05.184085 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5ac6e11f-edfe-49c3-978d-19e1f3709d7f tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:05.184511 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-5ac6e11f-edfe-49c3-978d-19e1f3709d7f tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:05.215111 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-5ac6e11f-edfe-49c3-978d-19e1f3709d7f tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/os-volume_attachments/8c96029d-a281-457f-bfd3-4b82e3506699" status: 200 len: 194 microversion: 2.1 time: 0.044527 Oct 28 12:37:05.215722 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 456/909] 10.222.0.62 () {58 vars in 1412 bytes} [Thu Oct 28 12:37:05 2021] GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/os-volume_attachments/8c96029d-a281-457f-bfd3-4b82e3506699 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:37:05.225426 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-8ffb4a17-92d1-4657-9562-cb472ca21f45 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:05.225834 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-8ffb4a17-92d1-4657-9562-cb472ca21f45 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:37:05.231788 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8ffb4a17-92d1-4657-9562-cb472ca21f45 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:05.232223 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8ffb4a17-92d1-4657-9562-cb472ca21f45 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:05.233014 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8ffb4a17-92d1-4657-9562-cb472ca21f45 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:05.233441 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-8ffb4a17-92d1-4657-9562-cb472ca21f45 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:05.313036 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.objects.instance [None req-8ffb4a17-92d1-4657-9562-cb472ca21f45 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lazy-loading 'services' on Instance uuid 3173757b-e9bd-478b-93ee-55b43fa30638 {{(pid=115876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:37:05.383953 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-8ffb4a17-92d1-4657-9562-cb472ca21f45 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "DELETE /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/os-volume_attachments/8c96029d-a281-457f-bfd3-4b82e3506699" status: 202 len: 0 microversion: 2.1 time: 0.162220 Oct 28 12:37:05.384968 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 454/910] 10.222.0.62 () {58 vars in 1415 bytes} [Thu Oct 28 12:37:05 2021] DELETE /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/os-volume_attachments/8c96029d-a281-457f-bfd3-4b82e3506699 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:37:06.516764 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-295ded12-c4dd-4970-8652-3bce9f0d7fc2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:06.517847 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-295ded12-c4dd-4970-8652-3bce9f0d7fc2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:37:06.524367 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-295ded12-c4dd-4970-8652-3bce9f0d7fc2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:06.524856 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-295ded12-c4dd-4970-8652-3bce9f0d7fc2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:06.525639 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-295ded12-c4dd-4970-8652-3bce9f0d7fc2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:06.526076 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-295ded12-c4dd-4970-8652-3bce9f0d7fc2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:06.559272 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-295ded12-c4dd-4970-8652-3bce9f0d7fc2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/os-volume_attachments/99b1d23d-17ce-40a7-bf00-28ae51c6d319" status: 200 len: 194 microversion: 2.1 time: 0.046573 Oct 28 12:37:06.560845 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 457/911] 10.222.0.62 () {58 vars in 1412 bytes} [Thu Oct 28 12:37:06 2021] GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/os-volume_attachments/99b1d23d-17ce-40a7-bf00-28ae51c6d319 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:37:06.570705 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-43ba7f7d-e34a-4fa8-91cf-290895854309 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:06.571272 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-43ba7f7d-e34a-4fa8-91cf-290895854309 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:37:06.578490 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-43ba7f7d-e34a-4fa8-91cf-290895854309 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:06.578945 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-43ba7f7d-e34a-4fa8-91cf-290895854309 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:06.579843 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-43ba7f7d-e34a-4fa8-91cf-290895854309 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:06.580261 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-43ba7f7d-e34a-4fa8-91cf-290895854309 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:06.668038 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.objects.instance [None req-43ba7f7d-e34a-4fa8-91cf-290895854309 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lazy-loading 'services' on Instance uuid 3173757b-e9bd-478b-93ee-55b43fa30638 {{(pid=115876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:37:06.746953 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-43ba7f7d-e34a-4fa8-91cf-290895854309 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "DELETE /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/os-volume_attachments/99b1d23d-17ce-40a7-bf00-28ae51c6d319" status: 202 len: 0 microversion: 2.1 time: 0.180176 Oct 28 12:37:06.747888 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 455/912] 10.222.0.62 () {58 vars in 1415 bytes} [Thu Oct 28 12:37:06 2021] DELETE /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/os-volume_attachments/99b1d23d-17ce-40a7-bf00-28ae51c6d319 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:37:07.930887 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-33b7bd71-d8d5-46b8-a65c-8eb6ab0c9acf tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:07.931877 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-33b7bd71-d8d5-46b8-a65c-8eb6ab0c9acf tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:37:07.939310 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-33b7bd71-d8d5-46b8-a65c-8eb6ab0c9acf tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:07.939605 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-33b7bd71-d8d5-46b8-a65c-8eb6ab0c9acf tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:07.940305 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-33b7bd71-d8d5-46b8-a65c-8eb6ab0c9acf tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:07.940856 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-33b7bd71-d8d5-46b8-a65c-8eb6ab0c9acf tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:07.983716 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-33b7bd71-d8d5-46b8-a65c-8eb6ab0c9acf tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056943 Oct 28 12:37:07.984761 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 458/913] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Oct 28 12:37:07 2021] GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:37:08.101094 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-14e51c72-b1c8-43ad-8c3b-3bdd8e654e2b tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:08.102122 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-14e51c72-b1c8-43ad-8c3b-3bdd8e654e2b tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:37:08.109069 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-14e51c72-b1c8-43ad-8c3b-3bdd8e654e2b tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:08.109541 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-14e51c72-b1c8-43ad-8c3b-3bdd8e654e2b tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:08.110265 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-14e51c72-b1c8-43ad-8c3b-3bdd8e654e2b tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:08.110682 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-14e51c72-b1c8-43ad-8c3b-3bdd8e654e2b tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:08.141116 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-14e51c72-b1c8-43ad-8c3b-3bdd8e654e2b tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044073 Oct 28 12:37:08.142073 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 456/914] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Oct 28 12:37:08 2021] GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:37:08.208631 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-24e4d57c-3881-4cab-a64e-e0a6862a8a77 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:08.209282 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-24e4d57c-3881-4cab-a64e-e0a6862a8a77 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:37:08.218089 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-24e4d57c-3881-4cab-a64e-e0a6862a8a77 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:08.218509 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-24e4d57c-3881-4cab-a64e-e0a6862a8a77 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:08.219307 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-24e4d57c-3881-4cab-a64e-e0a6862a8a77 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:08.219732 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-24e4d57c-3881-4cab-a64e-e0a6862a8a77 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:08.246311 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-24e4d57c-3881-4cab-a64e-e0a6862a8a77 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Going to try to terminate instance {{(pid=115877) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:37:08.335927 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-24e4d57c-3881-4cab-a64e-e0a6862a8a77 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "DELETE /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638" status: 204 len: 0 microversion: 2.1 time: 0.133179 Oct 28 12:37:08.336626 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 459/915] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Oct 28 12:37:08 2021] DELETE /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 12:37:08.346341 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-ce2dd732-95de-45cc-933a-d8ad3496f43d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:08.346940 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-ce2dd732-95de-45cc-933a-d8ad3496f43d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:37:08.353429 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ce2dd732-95de-45cc-933a-d8ad3496f43d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:08.353862 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ce2dd732-95de-45cc-933a-d8ad3496f43d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:08.354987 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ce2dd732-95de-45cc-933a-d8ad3496f43d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:08.354987 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ce2dd732-95de-45cc-933a-d8ad3496f43d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:08.489014 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-ce2dd732-95de-45cc-933a-d8ad3496f43d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:37:08.496932 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-ce2dd732-95de-45cc-933a-d8ad3496f43d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638" status: 200 len: 1672 microversion: 2.1 time: 0.154218 Oct 28 12:37:08.497535 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 457/916] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:37:08 2021] GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:37:09.515383 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-54b0d87a-7d24-4cfc-9e22-aafb0152c2b3 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:09.516659 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-54b0d87a-7d24-4cfc-9e22-aafb0152c2b3 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:37:09.523890 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-54b0d87a-7d24-4cfc-9e22-aafb0152c2b3 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:09.524402 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-54b0d87a-7d24-4cfc-9e22-aafb0152c2b3 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:09.525212 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-54b0d87a-7d24-4cfc-9e22-aafb0152c2b3 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:09.525811 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-54b0d87a-7d24-4cfc-9e22-aafb0152c2b3 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:09.685686 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-54b0d87a-7d24-4cfc-9e22-aafb0152c2b3 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:37:09.694079 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-54b0d87a-7d24-4cfc-9e22-aafb0152c2b3 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638" status: 200 len: 1672 microversion: 2.1 time: 0.183084 Oct 28 12:37:09.694683 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 460/917] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:37:09 2021] GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638 => generated 1672 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:37:10.711569 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-91667684-06a5-46b7-b54d-fa4da1d91580 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:10.712138 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-91667684-06a5-46b7-b54d-fa4da1d91580 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:37:10.718668 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-91667684-06a5-46b7-b54d-fa4da1d91580 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:10.719077 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-91667684-06a5-46b7-b54d-fa4da1d91580 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:10.719872 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-91667684-06a5-46b7-b54d-fa4da1d91580 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:10.720513 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-91667684-06a5-46b7-b54d-fa4da1d91580 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:10.792169 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-91667684-06a5-46b7-b54d-fa4da1d91580 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f15cc4fe5a4148984af18a9a49fa31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5337ec1ac12488aa4e8ecbab298da10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:37:10.801399 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-91667684-06a5-46b7-b54d-fa4da1d91580 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638" status: 200 len: 1604 microversion: 2.1 time: 0.093530 Oct 28 12:37:10.802331 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 458/918] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:37:10 2021] GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638 => generated 1604 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:37:11.078767 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-21442a58-fc21-4929-a562-46f1b8c7ca14 req-366fcb41-a84e-4426-8a9e-2dd31c88a194 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3173757b-e9bd-478b-93ee-55b43fa30638", "name": "network-vif-deleted", "tag": "07d4f5a8-2fdd-4368-8fd4-1b5d39b142a1"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:37:11.080346 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:37:11.080346 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:37:11.088116 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-21442a58-fc21-4929-a562-46f1b8c7ca14 req-366fcb41-a84e-4426-8a9e-2dd31c88a194 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:11.088565 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-21442a58-fc21-4929-a562-46f1b8c7ca14 req-366fcb41-a84e-4426-8a9e-2dd31c88a194 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:11.100459 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-21442a58-fc21-4929-a562-46f1b8c7ca14 req-366fcb41-a84e-4426-8a9e-2dd31c88a194 service nova] Creating event network-vif-deleted:07d4f5a8-2fdd-4368-8fd4-1b5d39b142a1 for instance 3173757b-e9bd-478b-93ee-55b43fa30638 on hv-cinder-81514 Oct 28 12:37:11.106072 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-21442a58-fc21-4929-a562-46f1b8c7ca14 req-366fcb41-a84e-4426-8a9e-2dd31c88a194 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030884 Oct 28 12:37:11.107513 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 461/919] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:37:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:37:11.818484 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-0f8d2424-fbb8-48c4-8f52-b23297226bb2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:11.819168 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-0f8d2424-fbb8-48c4-8f52-b23297226bb2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:37:11.825979 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-0f8d2424-fbb8-48c4-8f52-b23297226bb2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:11.826526 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-0f8d2424-fbb8-48c4-8f52-b23297226bb2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:11.827330 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-0f8d2424-fbb8-48c4-8f52-b23297226bb2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:11.827761 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-0f8d2424-fbb8-48c4-8f52-b23297226bb2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:11.844026 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.wsgi [None req-0f8d2424-fbb8-48c4-8f52-b23297226bb2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] HTTP exception thrown: Instance 3173757b-e9bd-478b-93ee-55b43fa30638 could not be found. Oct 28 12:37:11.844608 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-0f8d2424-fbb8-48c4-8f52-b23297226bb2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Returning 404 to user: Instance 3173757b-e9bd-478b-93ee-55b43fa30638 could not be found. {{(pid=115876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:37:11.845512 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-0f8d2424-fbb8-48c4-8f52-b23297226bb2 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638" status: 404 len: 111 microversion: 2.1 time: 0.030969 Oct 28 12:37:11.846062 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 459/920] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:37:11 2021] GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:37:11.855278 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-9dac8189-b9e2-46a1-a47b-caf0b8cc65e6 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '.version_select at 0x7f4a79343b80>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:11.874905 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-9dac8189-b9e2-46a1-a47b-caf0b8cc65e6 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1011525555" status: 202 len: 0 microversion: 2.1 time: 0.023892 Oct 28 12:37:11.875489 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 462/921] 10.222.0.62 () {58 vars in 1220 bytes} [Thu Oct 28 12:37:11 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1011525555 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:37:14.822154 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-26db9525-6850-4ee0-84cb-3dd365936c3d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:14.822651 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-26db9525-6850-4ee0-84cb-3dd365936c3d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:37:14.829540 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-26db9525-6850-4ee0-84cb-3dd365936c3d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:14.829940 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-26db9525-6850-4ee0-84cb-3dd365936c3d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:14.830893 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-26db9525-6850-4ee0-84cb-3dd365936c3d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:14.831336 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-26db9525-6850-4ee0-84cb-3dd365936c3d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:14.845418 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.wsgi [None req-26db9525-6850-4ee0-84cb-3dd365936c3d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] HTTP exception thrown: Instance 3173757b-e9bd-478b-93ee-55b43fa30638 could not be found. Oct 28 12:37:14.845990 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-26db9525-6850-4ee0-84cb-3dd365936c3d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Returning 404 to user: Instance 3173757b-e9bd-478b-93ee-55b43fa30638 could not be found. {{(pid=115876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:37:14.846809 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-26db9525-6850-4ee0-84cb-3dd365936c3d tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "DELETE /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638" status: 404 len: 111 microversion: 2.1 time: 0.028359 Oct 28 12:37:14.847343 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 460/922] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Oct 28 12:37:14 2021] DELETE /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:37:14.861078 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-b27c90d2-1ccc-4059-8f1d-b016ce9b37f9 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:14.861962 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-b27c90d2-1ccc-4059-8f1d-b016ce9b37f9 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 3173757b-e9bd-478b-93ee-55b43fa30638] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:37:14.869722 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b27c90d2-1ccc-4059-8f1d-b016ce9b37f9 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:14.870169 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b27c90d2-1ccc-4059-8f1d-b016ce9b37f9 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:14.870942 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b27c90d2-1ccc-4059-8f1d-b016ce9b37f9 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:14.871370 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b27c90d2-1ccc-4059-8f1d-b016ce9b37f9 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:14.884989 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.wsgi [None req-b27c90d2-1ccc-4059-8f1d-b016ce9b37f9 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] HTTP exception thrown: Instance 3173757b-e9bd-478b-93ee-55b43fa30638 could not be found. Oct 28 12:37:14.885573 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-b27c90d2-1ccc-4059-8f1d-b016ce9b37f9 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Returning 404 to user: Instance 3173757b-e9bd-478b-93ee-55b43fa30638 could not be found. {{(pid=115877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:37:14.886405 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-b27c90d2-1ccc-4059-8f1d-b016ce9b37f9 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638" status: 404 len: 111 microversion: 2.1 time: 0.033153 Oct 28 12:37:14.886932 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 463/923] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:37:14 2021] GET /compute/v2.1/servers/3173757b-e9bd-478b-93ee-55b43fa30638 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:37:16.025044 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-760eb99e-852b-46fa-9379-d8bdbf7deaf1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:16.025585 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-760eb99e-852b-46fa-9379-d8bdbf7deaf1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:37:16.032948 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-760eb99e-852b-46fa-9379-d8bdbf7deaf1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:16.033387 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-760eb99e-852b-46fa-9379-d8bdbf7deaf1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:16.034136 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-760eb99e-852b-46fa-9379-d8bdbf7deaf1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:16.034563 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-760eb99e-852b-46fa-9379-d8bdbf7deaf1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:16.048294 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.wsgi [None req-760eb99e-852b-46fa-9379-d8bdbf7deaf1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] HTTP exception thrown: Instance 1b133627-e4a2-43dc-9613-8ef3d028862b could not be found. Oct 28 12:37:16.048829 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-760eb99e-852b-46fa-9379-d8bdbf7deaf1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Returning 404 to user: Instance 1b133627-e4a2-43dc-9613-8ef3d028862b could not be found. {{(pid=115876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:37:16.049639 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-760eb99e-852b-46fa-9379-d8bdbf7deaf1 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "DELETE /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 404 len: 111 microversion: 2.1 time: 0.028368 Oct 28 12:37:16.050158 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 461/924] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Oct 28 12:37:16 2021] DELETE /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:37:16.058461 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-740b37bf-1347-495f-9a8f-a55619e12966 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:16.059047 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-740b37bf-1347-495f-9a8f-a55619e12966 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] [instance: 1b133627-e4a2-43dc-9613-8ef3d028862b] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:37:16.065628 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-740b37bf-1347-495f-9a8f-a55619e12966 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:16.066062 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-740b37bf-1347-495f-9a8f-a55619e12966 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:16.066818 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-740b37bf-1347-495f-9a8f-a55619e12966 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:16.067236 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-740b37bf-1347-495f-9a8f-a55619e12966 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:16.080446 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.wsgi [None req-740b37bf-1347-495f-9a8f-a55619e12966 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] HTTP exception thrown: Instance 1b133627-e4a2-43dc-9613-8ef3d028862b could not be found. Oct 28 12:37:16.081053 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-740b37bf-1347-495f-9a8f-a55619e12966 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] Returning 404 to user: Instance 1b133627-e4a2-43dc-9613-8ef3d028862b could not be found. {{(pid=115877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:37:16.081858 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-740b37bf-1347-495f-9a8f-a55619e12966 tempest-AttachVolumeTestJSON-1008798368 tempest-AttachVolumeTestJSON-1008798368-project] 10.222.0.62 "GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b" status: 404 len: 111 microversion: 2.1 time: 0.027083 Oct 28 12:37:16.082371 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 464/925] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:37:16 2021] GET /compute/v2.1/servers/1b133627-e4a2-43dc-9613-8ef3d028862b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 12:37:36.980052 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-59e9419f-8e1f-47de-bd80-6959d33341d2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:36.981077 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-59e9419f-8e1f-47de-bd80-6959d33341d2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:37:36.987582 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-59e9419f-8e1f-47de-bd80-6959d33341d2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:36.988021 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-59e9419f-8e1f-47de-bd80-6959d33341d2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:36.988806 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-59e9419f-8e1f-47de-bd80-6959d33341d2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:36.989227 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-59e9419f-8e1f-47de-bd80-6959d33341d2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:37.018937 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-59e9419f-8e1f-47de-bd80-6959d33341d2 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042806 Oct 28 12:37:37.019541 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 462/926] 10.222.0.62 () {60 vars in 1342 bytes} [Thu Oct 28 12:37:36 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:37:37.076169 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-73d2450b-391b-4256-a6b5-c1a00c6b55f0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:37.076755 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-73d2450b-391b-4256-a6b5-c1a00c6b55f0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:37:37.082857 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-73d2450b-391b-4256-a6b5-c1a00c6b55f0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:37.083292 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-73d2450b-391b-4256-a6b5-c1a00c6b55f0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:37.084044 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-73d2450b-391b-4256-a6b5-c1a00c6b55f0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:37.084468 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-73d2450b-391b-4256-a6b5-c1a00c6b55f0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:37.109778 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-73d2450b-391b-4256-a6b5-c1a00c6b55f0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Going to try to terminate instance {{(pid=115877) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:37:37.189050 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-73d2450b-391b-4256-a6b5-c1a00c6b55f0 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 204 len: 0 microversion: 2.20 time: 0.116548 Oct 28 12:37:37.189828 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 465/927] 10.222.0.62 () {60 vars in 1279 bytes} [Thu Oct 28 12:37:37 2021] DELETE /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 12:37:37.198282 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-998bb98e-d366-4617-bd2b-db301124beea tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:37.199158 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-998bb98e-d366-4617-bd2b-db301124beea tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:37:37.205044 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-998bb98e-d366-4617-bd2b-db301124beea tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:37.205481 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-998bb98e-d366-4617-bd2b-db301124beea tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:37.206240 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-998bb98e-d366-4617-bd2b-db301124beea tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:37.206990 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-998bb98e-d366-4617-bd2b-db301124beea tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:37.329407 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-998bb98e-d366-4617-bd2b-db301124beea tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:37:37.337424 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-998bb98e-d366-4617-bd2b-db301124beea tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:37:37.338885 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-998bb98e-d366-4617-bd2b-db301124beea tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:37:37.340179 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-998bb98e-d366-4617-bd2b-db301124beea tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1720 microversion: 2.20 time: 0.145604 Oct 28 12:37:37.340764 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 463/928] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:37:37 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1720 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:37:38.359807 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-ab88e548-2528-4fd5-b4eb-265967a7333e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:38.360395 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-ab88e548-2528-4fd5-b4eb-265967a7333e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:37:38.367295 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ab88e548-2528-4fd5-b4eb-265967a7333e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:38.367737 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ab88e548-2528-4fd5-b4eb-265967a7333e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:38.368493 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ab88e548-2528-4fd5-b4eb-265967a7333e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:38.368964 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ab88e548-2528-4fd5-b4eb-265967a7333e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:38.495645 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-ab88e548-2528-4fd5-b4eb-265967a7333e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:37:38.504169 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-ab88e548-2528-4fd5-b4eb-265967a7333e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:37:38.505689 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-ab88e548-2528-4fd5-b4eb-265967a7333e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:37:38.506849 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-ab88e548-2528-4fd5-b4eb-265967a7333e tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1720 microversion: 2.20 time: 0.151850 Oct 28 12:37:38.507415 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 466/929] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:37:38 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:37:39.525133 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-4d1c7b26-40b9-4fd3-a7cb-6105a712c6c4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:39.525746 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-4d1c7b26-40b9-4fd3-a7cb-6105a712c6c4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:37:39.532455 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4d1c7b26-40b9-4fd3-a7cb-6105a712c6c4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:39.532930 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4d1c7b26-40b9-4fd3-a7cb-6105a712c6c4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:39.533707 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4d1c7b26-40b9-4fd3-a7cb-6105a712c6c4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:39.534130 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-4d1c7b26-40b9-4fd3-a7cb-6105a712c6c4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:39.644370 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-4d1c7b26-40b9-4fd3-a7cb-6105a712c6c4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:37:39.652557 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-4d1c7b26-40b9-4fd3-a7cb-6105a712c6c4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:37:39.654146 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-4d1c7b26-40b9-4fd3-a7cb-6105a712c6c4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d38f499bdf74241a876e06ca3e05503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae5fd59e495402c829af6819f873149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:37:39.655309 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-4d1c7b26-40b9-4fd3-a7cb-6105a712c6c4 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 200 len: 1653 microversion: 2.20 time: 0.134094 Oct 28 12:37:39.655870 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 464/930] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:37:39 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 1653 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:37:39.728934 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-f25aeebf-84fb-4585-a592-9adedb3c431d req-d4b38c05-2f06-4c7e-ae7b-d645c19a10d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726", "name": "network-vif-deleted", "tag": "c25d48e4-43fb-464d-a891-6f40b7296a25"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:37:39.730706 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:37:39.730706 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:37:39.739198 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-f25aeebf-84fb-4585-a592-9adedb3c431d req-d4b38c05-2f06-4c7e-ae7b-d645c19a10d1 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:39.739634 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-f25aeebf-84fb-4585-a592-9adedb3c431d req-d4b38c05-2f06-4c7e-ae7b-d645c19a10d1 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:39.755723 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-f25aeebf-84fb-4585-a592-9adedb3c431d req-d4b38c05-2f06-4c7e-ae7b-d645c19a10d1 service nova] Creating event network-vif-deleted:c25d48e4-43fb-464d-a891-6f40b7296a25 for instance c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 on hv-cinder-81514 Oct 28 12:37:39.762532 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-f25aeebf-84fb-4585-a592-9adedb3c431d req-d4b38c05-2f06-4c7e-ae7b-d645c19a10d1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037353 Oct 28 12:37:39.763200 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 467/931] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:37:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:37:40.673658 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-a4a004c6-c9d0-413d-b0b4-a192cd48e5bb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:40.674232 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-a4a004c6-c9d0-413d-b0b4-a192cd48e5bb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:37:40.681424 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a4a004c6-c9d0-413d-b0b4-a192cd48e5bb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:40.681861 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a4a004c6-c9d0-413d-b0b4-a192cd48e5bb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:40.682626 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a4a004c6-c9d0-413d-b0b4-a192cd48e5bb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:40.683047 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a4a004c6-c9d0-413d-b0b4-a192cd48e5bb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:40.699253 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.wsgi [None req-a4a004c6-c9d0-413d-b0b4-a192cd48e5bb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] HTTP exception thrown: Instance c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 could not be found. Oct 28 12:37:40.699965 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-a4a004c6-c9d0-413d-b0b4-a192cd48e5bb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Returning 404 to user: Instance c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 could not be found. {{(pid=115876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:37:40.700890 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-a4a004c6-c9d0-413d-b0b4-a192cd48e5bb tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 404 len: 111 microversion: 2.20 time: 0.030997 Oct 28 12:37:40.701371 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 465/932] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Oct 28 12:37:40 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 12:37:40.710790 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-54eba563-47ff-4575-bc4a-cf12b222e263 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '.version_select at 0x7f4a79343c10>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:40.730452 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-54eba563-47ff-4575-bc4a-cf12b222e263 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-216996260" status: 204 len: 0 microversion: 2.20 time: 0.023979 Oct 28 12:37:40.731511 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 468/933] 10.222.0.62 () {60 vars in 1258 bytes} [Thu Oct 28 12:37:40 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-216996260 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 12:37:48.005997 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-fe3dd82e-294a-4af1-a326-feb656039d22 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:48.006621 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-fe3dd82e-294a-4af1-a326-feb656039d22 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:37:48.013110 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fe3dd82e-294a-4af1-a326-feb656039d22 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:48.014551 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fe3dd82e-294a-4af1-a326-feb656039d22 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:48.014551 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fe3dd82e-294a-4af1-a326-feb656039d22 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:48.014796 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fe3dd82e-294a-4af1-a326-feb656039d22 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:48.030129 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.wsgi [None req-fe3dd82e-294a-4af1-a326-feb656039d22 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] HTTP exception thrown: Instance c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 could not be found. Oct 28 12:37:48.030903 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-fe3dd82e-294a-4af1-a326-feb656039d22 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Returning 404 to user: Instance c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 could not be found. {{(pid=115876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:37:48.031913 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-fe3dd82e-294a-4af1-a326-feb656039d22 tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 404 len: 111 microversion: 2.1 time: 0.029715 Oct 28 12:37:48.032583 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 466/934] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Oct 28 12:37:48 2021] DELETE /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:37:48.041679 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-94fb0675-1173-4aa9-88b6-5338c3bb8adf tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:48.042406 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-94fb0675-1173-4aa9-88b6-5338c3bb8adf tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:37:48.049043 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-94fb0675-1173-4aa9-88b6-5338c3bb8adf tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:48.049461 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-94fb0675-1173-4aa9-88b6-5338c3bb8adf tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:48.050230 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-94fb0675-1173-4aa9-88b6-5338c3bb8adf tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:48.051019 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-94fb0675-1173-4aa9-88b6-5338c3bb8adf tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:48.064392 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.wsgi [None req-94fb0675-1173-4aa9-88b6-5338c3bb8adf tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] HTTP exception thrown: Instance c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 could not be found. Oct 28 12:37:48.065008 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-94fb0675-1173-4aa9-88b6-5338c3bb8adf tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Returning 404 to user: Instance c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 could not be found. {{(pid=115877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:37:48.065831 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-94fb0675-1173-4aa9-88b6-5338c3bb8adf tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726" status: 404 len: 111 microversion: 2.1 time: 0.028387 Oct 28 12:37:48.066383 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 469/935] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:37:48 2021] GET /compute/v2.1/servers/c8ce7cec-a1ce-4167-8c83-b9b7f4aaa726 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:37:53.226707 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-1333873f-8fd5-4282-b7bb-ab73688c13f4 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1858514292", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1357312688", "security_groups": [{"name": "tempest-secgroup-smoke-1509298390"}], "block_device_mapping_v2": [{"uuid": "ea2ba6ab-eca8-4864-b88e-aa2ffa163267", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "21386cb8-b310-4d7a-bddd-fd2d5b5b89a3"}]}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:37:53.327717 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.network.neutron [None req-1333873f-8fd5-4282-b7bb-ab73688c13f4 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] validate_networks() for [('21386cb8-b310-4d7a-bddd-fd2d5b5b89a3', None, None, None, None, None)] {{(pid=115876) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:37:53.409556 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-3667a6a2-2837-4bed-b084-3c489930a8dc tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:53.410058 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-3667a6a2-2837-4bed-b084-3c489930a8dc tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:37:53.416061 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3667a6a2-2837-4bed-b084-3c489930a8dc tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:53.416557 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3667a6a2-2837-4bed-b084-3c489930a8dc tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:53.417534 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3667a6a2-2837-4bed-b084-3c489930a8dc tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:53.417954 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3667a6a2-2837-4bed-b084-3c489930a8dc tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:53.431715 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.wsgi [None req-3667a6a2-2837-4bed-b084-3c489930a8dc tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] HTTP exception thrown: Instance f6a3a830-8175-434e-8c23-336ccacf7ef8 could not be found. Oct 28 12:37:53.432290 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-3667a6a2-2837-4bed-b084-3c489930a8dc tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Returning 404 to user: Instance f6a3a830-8175-434e-8c23-336ccacf7ef8 could not be found. {{(pid=115877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:37:53.433249 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-3667a6a2-2837-4bed-b084-3c489930a8dc tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 404 len: 111 microversion: 2.1 time: 0.028922 Oct 28 12:37:53.433989 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 470/936] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Oct 28 12:37:53 2021] DELETE /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:37:53.442157 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-1e025355-72c3-41bb-b6ab-32da179a8cbf tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:53.442752 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-1e025355-72c3-41bb-b6ab-32da179a8cbf tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] [instance: f6a3a830-8175-434e-8c23-336ccacf7ef8] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:37:53.448703 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1e025355-72c3-41bb-b6ab-32da179a8cbf tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:53.449161 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1e025355-72c3-41bb-b6ab-32da179a8cbf tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:53.449926 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1e025355-72c3-41bb-b6ab-32da179a8cbf tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:53.450348 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1e025355-72c3-41bb-b6ab-32da179a8cbf tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:53.463872 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.wsgi [None req-1e025355-72c3-41bb-b6ab-32da179a8cbf tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] HTTP exception thrown: Instance f6a3a830-8175-434e-8c23-336ccacf7ef8 could not be found. Oct 28 12:37:53.464452 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-1e025355-72c3-41bb-b6ab-32da179a8cbf tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] Returning 404 to user: Instance f6a3a830-8175-434e-8c23-336ccacf7ef8 could not be found. {{(pid=115877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:37:53.465316 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-1e025355-72c3-41bb-b6ab-32da179a8cbf tempest-AttachVolumeShelveTestJSON-1563775836 tempest-AttachVolumeShelveTestJSON-1563775836-project] 10.222.0.62 "GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8" status: 404 len: 111 microversion: 2.1 time: 0.027280 Oct 28 12:37:53.465869 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 471/937] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:37:53 2021] GET /compute/v2.1/servers/f6a3a830-8175-434e-8c23-336ccacf7ef8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 12:37:53.742604 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-1333873f-8fd5-4282-b7bb-ab73688c13f4 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Flavor limits 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:37:53.743032 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-1333873f-8fd5-4282-b7bb-ab73688c13f4 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Image limits 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:37:53.743497 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-1333873f-8fd5-4282-b7bb-ab73688c13f4 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Flavor pref 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:37:53.743895 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-1333873f-8fd5-4282-b7bb-ab73688c13f4 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Image pref 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:37:53.744294 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-1333873f-8fd5-4282-b7bb-ab73688c13f4 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:37:53.753184 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1333873f-8fd5-4282-b7bb-ab73688c13f4 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:53.753625 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1333873f-8fd5-4282-b7bb-ab73688c13f4 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:53.754414 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1333873f-8fd5-4282-b7bb-ab73688c13f4 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:53.754841 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1333873f-8fd5-4282-b7bb-ab73688c13f4 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:53.771496 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-1333873f-8fd5-4282-b7bb-ab73688c13f4 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Getting quotas for project 70a330da99234af6b3a80df822d5067f. Resources: {'cores', 'instances', 'ram'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:37:53.775641 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-1333873f-8fd5-4282-b7bb-ab73688c13f4 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Getting quotas for user 4303ee654346434cb52fa498176297b1 and project 70a330da99234af6b3a80df822d5067f. Resources: {'cores', 'instances', 'ram'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:37:53.831513 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-1333873f-8fd5-4282-b7bb-ab73688c13f4 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Going to run 1 instances... {{(pid=115876) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:37:53.833777 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-1333873f-8fd5-4282-b7bb-ab73688c13f4 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a6225d80-7446-4e30-89b9-b7b0551f5e35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ea2ba6ab-eca8-4864-b88e-aa2ffa163267',volume_size=None,volume_type=None)] {{(pid=115876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:37:53.975281 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-1333873f-8fd5-4282-b7bb-ab73688c13f4 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.752635 Oct 28 12:37:53.975530 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 467/938] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Oct 28 12:37:53 2021] POST /compute/v2.1/servers => generated 406 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 12:37:53.987301 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-de78e1a0-b067-465c-b62c-26db88a8070f tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:53.987906 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-de78e1a0-b067-465c-b62c-26db88a8070f tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a6225d80-7446-4e30-89b9-b7b0551f5e35] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:37:54.057701 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-de78e1a0-b067-465c-b62c-26db88a8070f tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:37:54.065637 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-de78e1a0-b067-465c-b62c-26db88a8070f tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35" status: 200 len: 1095 microversion: 2.1 time: 0.082649 Oct 28 12:37:54.066370 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 472/939] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:37:53 2021] GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35 => generated 1095 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:37:55.084213 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-e600f74b-9e46-4620-8d6f-04f8346b98c3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:55.084874 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-e600f74b-9e46-4620-8d6f-04f8346b98c3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a6225d80-7446-4e30-89b9-b7b0551f5e35] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:37:55.095145 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e600f74b-9e46-4620-8d6f-04f8346b98c3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:55.096573 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e600f74b-9e46-4620-8d6f-04f8346b98c3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:55.096573 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e600f74b-9e46-4620-8d6f-04f8346b98c3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:55.099529 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e600f74b-9e46-4620-8d6f-04f8346b98c3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:55.205279 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-e600f74b-9e46-4620-8d6f-04f8346b98c3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:37:55.212804 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-e600f74b-9e46-4620-8d6f-04f8346b98c3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35" status: 200 len: 1211 microversion: 2.1 time: 0.133666 Oct 28 12:37:55.214000 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 468/940] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:37:55 2021] GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35 => generated 1211 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:37:56.232291 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-d057e698-24df-4eb8-857d-374edeca0e0c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:56.233165 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-d057e698-24df-4eb8-857d-374edeca0e0c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a6225d80-7446-4e30-89b9-b7b0551f5e35] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:37:56.240521 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d057e698-24df-4eb8-857d-374edeca0e0c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:56.241430 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d057e698-24df-4eb8-857d-374edeca0e0c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:56.243418 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d057e698-24df-4eb8-857d-374edeca0e0c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:56.244054 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d057e698-24df-4eb8-857d-374edeca0e0c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:56.467350 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-d057e698-24df-4eb8-857d-374edeca0e0c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:37:56.480184 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-d057e698-24df-4eb8-857d-374edeca0e0c tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35" status: 200 len: 1267 microversion: 2.1 time: 0.252802 Oct 28 12:37:56.490524 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 473/941] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:37:56 2021] GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35 => generated 1267 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:37:56.930800 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-c81eb1f3-fc46-4f96-9238-d1eb341512a5 req-e8d26bb5-72d6-49e6-b9f7-bf416e075653 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6225d80-7446-4e30-89b9-b7b0551f5e35", "tag": "223ceb5a-9a7d-4a4d-8f6b-caa04ae0b0b0"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:37:56.933298 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:37:56.933298 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:37:56.957175 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-c81eb1f3-fc46-4f96-9238-d1eb341512a5 req-e8d26bb5-72d6-49e6-b9f7-bf416e075653 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:56.959114 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-c81eb1f3-fc46-4f96-9238-d1eb341512a5 req-e8d26bb5-72d6-49e6-b9f7-bf416e075653 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:56.981875 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-c81eb1f3-fc46-4f96-9238-d1eb341512a5 req-e8d26bb5-72d6-49e6-b9f7-bf416e075653 service nova] Creating event network-changed:223ceb5a-9a7d-4a4d-8f6b-caa04ae0b0b0 for instance a6225d80-7446-4e30-89b9-b7b0551f5e35 on hv-cinder-81514 Oct 28 12:37:56.987618 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-c81eb1f3-fc46-4f96-9238-d1eb341512a5 req-e8d26bb5-72d6-49e6-b9f7-bf416e075653 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062997 Oct 28 12:37:56.988425 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 469/942] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:37:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:37:57.499472 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-d53864ac-2aa3-47ca-86aa-f090e51ac1df tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:57.500071 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-d53864ac-2aa3-47ca-86aa-f090e51ac1df tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a6225d80-7446-4e30-89b9-b7b0551f5e35] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:37:57.506785 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d53864ac-2aa3-47ca-86aa-f090e51ac1df tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:57.507379 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d53864ac-2aa3-47ca-86aa-f090e51ac1df tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:57.508306 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d53864ac-2aa3-47ca-86aa-f090e51ac1df tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:57.508867 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d53864ac-2aa3-47ca-86aa-f090e51ac1df tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:58.118667 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-d53864ac-2aa3-47ca-86aa-f090e51ac1df tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:37:58.126647 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-d53864ac-2aa3-47ca-86aa-f090e51ac1df tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35" status: 200 len: 1267 microversion: 2.1 time: 0.632437 Oct 28 12:37:58.127234 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 474/943] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:37:57 2021] GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35 => generated 1267 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:37:59.146292 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-6a46ff62-bf60-4112-813f-4f8cf754df41 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:37:59.147025 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-6a46ff62-bf60-4112-813f-4f8cf754df41 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a6225d80-7446-4e30-89b9-b7b0551f5e35] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:37:59.158674 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6a46ff62-bf60-4112-813f-4f8cf754df41 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:59.159183 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6a46ff62-bf60-4112-813f-4f8cf754df41 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:59.160037 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6a46ff62-bf60-4112-813f-4f8cf754df41 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:37:59.160582 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6a46ff62-bf60-4112-813f-4f8cf754df41 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:37:59.309630 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-6a46ff62-bf60-4112-813f-4f8cf754df41 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:37:59.321009 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-6a46ff62-bf60-4112-813f-4f8cf754df41 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35" status: 200 len: 1267 microversion: 2.1 time: 0.179507 Oct 28 12:37:59.321576 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 470/944] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:37:59 2021] GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35 => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:38:00.342675 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-86ae9e7f-ad15-4923-bc75-6bf5fb911222 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:38:00.343773 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-86ae9e7f-ad15-4923-bc75-6bf5fb911222 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a6225d80-7446-4e30-89b9-b7b0551f5e35] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:38:00.350809 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-86ae9e7f-ad15-4923-bc75-6bf5fb911222 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:38:00.351265 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-86ae9e7f-ad15-4923-bc75-6bf5fb911222 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:38:00.352076 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-86ae9e7f-ad15-4923-bc75-6bf5fb911222 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:38:00.352652 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-86ae9e7f-ad15-4923-bc75-6bf5fb911222 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:38:00.486432 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-86ae9e7f-ad15-4923-bc75-6bf5fb911222 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:38:00.494291 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-86ae9e7f-ad15-4923-bc75-6bf5fb911222 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35" status: 200 len: 1267 microversion: 2.1 time: 0.158857 Oct 28 12:38:00.495113 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 475/945] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:38:00 2021] GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:38:01.516182 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-39ca65da-ec93-430b-ae19-1ac56bc59607 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:38:01.516957 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-39ca65da-ec93-430b-ae19-1ac56bc59607 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a6225d80-7446-4e30-89b9-b7b0551f5e35] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:38:01.524168 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-39ca65da-ec93-430b-ae19-1ac56bc59607 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:38:01.524609 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-39ca65da-ec93-430b-ae19-1ac56bc59607 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:38:01.525455 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-39ca65da-ec93-430b-ae19-1ac56bc59607 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:38:01.525885 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-39ca65da-ec93-430b-ae19-1ac56bc59607 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:38:01.659803 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-39ca65da-ec93-430b-ae19-1ac56bc59607 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:38:01.668398 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-39ca65da-ec93-430b-ae19-1ac56bc59607 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35" status: 200 len: 1267 microversion: 2.1 time: 0.158320 Oct 28 12:38:01.668994 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 471/946] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:38:01 2021] GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:38:02.685828 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-84876132-aad5-4596-84dd-e1a81aedd113 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:38:02.686483 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-84876132-aad5-4596-84dd-e1a81aedd113 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a6225d80-7446-4e30-89b9-b7b0551f5e35] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:38:02.692751 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-84876132-aad5-4596-84dd-e1a81aedd113 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:38:02.693230 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-84876132-aad5-4596-84dd-e1a81aedd113 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:38:02.694002 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-84876132-aad5-4596-84dd-e1a81aedd113 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:38:02.694418 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-84876132-aad5-4596-84dd-e1a81aedd113 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:38:02.823320 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-84876132-aad5-4596-84dd-e1a81aedd113 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:38:02.831199 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-84876132-aad5-4596-84dd-e1a81aedd113 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35" status: 200 len: 1267 microversion: 2.1 time: 0.149276 Oct 28 12:38:02.831753 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 476/947] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:38:02 2021] GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:38:03.008003 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-22662f4b-1723-4288-ac37-ee91fe320ccf tempest-VolumesTestJSON-1337999319 tempest-VolumesTestJSON-1337999319-project] Calling method '.version_select at 0x7f4a793c6ca0>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:38:03.061535 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-22662f4b-1723-4288-ac37-ee91fe320ccf tempest-VolumesTestJSON-1337999319 tempest-VolumesTestJSON-1337999319-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/7788b79f-c22b-419d-915b-fbad1f62ad47" status: 200 len: 351 microversion: 2.1 time: 0.057317 Oct 28 12:38:03.062117 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 472/948] 10.222.0.62 () {58 vars in 1244 bytes} [Thu Oct 28 12:38:03 2021] GET /compute/v2.1/os-volumes/7788b79f-c22b-419d-915b-fbad1f62ad47 => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:38:03.850592 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-aa980cc0-89f5-4618-99d2-036cbd9b870e tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:38:03.851211 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-aa980cc0-89f5-4618-99d2-036cbd9b870e tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a6225d80-7446-4e30-89b9-b7b0551f5e35] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:38:03.857994 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-aa980cc0-89f5-4618-99d2-036cbd9b870e tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:38:03.858439 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-aa980cc0-89f5-4618-99d2-036cbd9b870e tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:38:03.859206 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-aa980cc0-89f5-4618-99d2-036cbd9b870e tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:38:03.859739 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-aa980cc0-89f5-4618-99d2-036cbd9b870e tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:38:04.002578 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-aa980cc0-89f5-4618-99d2-036cbd9b870e tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:38:04.010407 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-aa980cc0-89f5-4618-99d2-036cbd9b870e tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35" status: 200 len: 1267 microversion: 2.1 time: 0.163722 Oct 28 12:38:04.010989 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 477/949] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:38:03 2021] GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:38:04.428839 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-42304d41-7061-415e-9baa-418d9c587cae tempest-VolumesTestJSON-1337999319 tempest-VolumesTestJSON-1337999319-project] Calling method '.version_select at 0x7f4a79309310>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:38:04.482950 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-42304d41-7061-415e-9baa-418d9c587cae tempest-VolumesTestJSON-1337999319 tempest-VolumesTestJSON-1337999319-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/c30c16db-ec40-4087-9e6e-1d6569899652" status: 200 len: 350 microversion: 2.1 time: 0.058388 Oct 28 12:38:04.483607 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 473/950] 10.222.0.62 () {58 vars in 1244 bytes} [Thu Oct 28 12:38:04 2021] GET /compute/v2.1/os-volumes/c30c16db-ec40-4087-9e6e-1d6569899652 => generated 350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:38:05.028602 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-a5505bf9-51d9-4272-ad35-ca18496d7bc5 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:38:05.029418 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-a5505bf9-51d9-4272-ad35-ca18496d7bc5 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a6225d80-7446-4e30-89b9-b7b0551f5e35] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:38:05.036247 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a5505bf9-51d9-4272-ad35-ca18496d7bc5 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:38:05.036920 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a5505bf9-51d9-4272-ad35-ca18496d7bc5 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:38:05.037786 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a5505bf9-51d9-4272-ad35-ca18496d7bc5 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:38:05.038251 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a5505bf9-51d9-4272-ad35-ca18496d7bc5 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:38:05.176691 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-a5505bf9-51d9-4272-ad35-ca18496d7bc5 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:38:05.184804 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-a5505bf9-51d9-4272-ad35-ca18496d7bc5 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35" status: 200 len: 1267 microversion: 2.1 time: 0.159984 Oct 28 12:38:05.185380 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 478/951] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:38:05 2021] GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:38:05.864013 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-f07b931d-1fc0-445e-8d2a-26ad5fed6411 tempest-VolumesTestJSON-1337999319 tempest-VolumesTestJSON-1337999319-project] Calling method '.version_select at 0x7f4a7943a820>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:38:05.915887 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-f07b931d-1fc0-445e-8d2a-26ad5fed6411 tempest-VolumesTestJSON-1337999319 tempest-VolumesTestJSON-1337999319-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/6372b4f3-7238-4caf-bf0c-9e4b3e28509d" status: 200 len: 351 microversion: 2.1 time: 0.057191 Oct 28 12:38:05.916498 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 474/952] 10.222.0.62 () {58 vars in 1244 bytes} [Thu Oct 28 12:38:05 2021] GET /compute/v2.1/os-volumes/6372b4f3-7238-4caf-bf0c-9e4b3e28509d => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:38:05.928824 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-fa5dcb80-a94a-4964-b9c0-47bd8e8e16e5 tempest-VolumesTestJSON-1337999319 tempest-VolumesTestJSON-1337999319-project] Calling method '.version_select at 0x7f4a79446ca0>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:38:06.010689 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-fa5dcb80-a94a-4964-b9c0-47bd8e8e16e5 tempest-VolumesTestJSON-1337999319 tempest-VolumesTestJSON-1337999319-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.085923 Oct 28 12:38:06.011280 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 479/953] 10.222.0.62 () {58 vars in 1133 bytes} [Thu Oct 28 12:38:05 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:38:06.025260 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-90ea56f9-8ba3-4101-b342-142d8741aae6 tempest-VolumesTestJSON-1337999319 tempest-VolumesTestJSON-1337999319-project] Calling method '.version_select at 0x7f4a792deaf0>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:38:06.104537 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-90ea56f9-8ba3-4101-b342-142d8741aae6 tempest-VolumesTestJSON-1337999319 tempest-VolumesTestJSON-1337999319-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.082848 Oct 28 12:38:06.105141 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 475/954] 10.222.0.62 () {58 vars in 1148 bytes} [Thu Oct 28 12:38:06 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:38:06.117542 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-c25a8329-7c3b-401e-899d-81a91829cdc2 tempest-VolumesTestJSON-1337999319 tempest-VolumesTestJSON-1337999319-project] Calling method '.version_select at 0x7f4a792eaa60>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:38:06.197802 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-c25a8329-7c3b-401e-899d-81a91829cdc2 tempest-VolumesTestJSON-1337999319 tempest-VolumesTestJSON-1337999319-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.084293 Oct 28 12:38:06.198341 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 480/955] 10.222.0.62 () {58 vars in 1133 bytes} [Thu Oct 28 12:38:06 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:38:06.207597 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-b8cb5e73-4c89-4eb1-8857-40a03ca502f0 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:38:06.208281 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-b8cb5e73-4c89-4eb1-8857-40a03ca502f0 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a6225d80-7446-4e30-89b9-b7b0551f5e35] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:38:06.215422 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-04e4c97f-ce3f-46c6-b67f-8c0c5db4ec32 tempest-VolumesTestJSON-1337999319 tempest-VolumesTestJSON-1337999319-project] Calling method '.version_select at 0x7f4a7940edc0>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:38:06.227344 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b8cb5e73-4c89-4eb1-8857-40a03ca502f0 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:38:06.228038 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b8cb5e73-4c89-4eb1-8857-40a03ca502f0 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:38:06.230340 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b8cb5e73-4c89-4eb1-8857-40a03ca502f0 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:38:06.230989 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b8cb5e73-4c89-4eb1-8857-40a03ca502f0 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:38:06.302781 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-04e4c97f-ce3f-46c6-b67f-8c0c5db4ec32 tempest-VolumesTestJSON-1337999319 tempest-VolumesTestJSON-1337999319-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.091054 Oct 28 12:38:06.303752 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 481/956] 10.222.0.62 () {58 vars in 1166 bytes} [Thu Oct 28 12:38:06 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:38:06.316953 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-dbff78b5-1665-4e62-881f-434946d41016 tempest-VolumesTestJSON-1337999319 tempest-VolumesTestJSON-1337999319-project] Calling method '.version_select at 0x7f4a79336ca0>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:38:06.376556 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-b8cb5e73-4c89-4eb1-8857-40a03ca502f0 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:38:06.383940 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-b8cb5e73-4c89-4eb1-8857-40a03ca502f0 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35" status: 200 len: 1267 microversion: 2.1 time: 0.180484 Oct 28 12:38:06.384500 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 476/957] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:38:06 2021] GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35 => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:38:06.400274 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-dbff78b5-1665-4e62-881f-434946d41016 tempest-VolumesTestJSON-1337999319 tempest-VolumesTestJSON-1337999319-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087333 Oct 28 12:38:06.400866 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 482/958] 10.222.0.62 () {58 vars in 1169 bytes} [Thu Oct 28 12:38:06 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:38:06.412585 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-14c54725-c668-43b7-a809-97cfb155e6d6 tempest-VolumesTestJSON-1337999319 tempest-VolumesTestJSON-1337999319-project] Calling method '.version_select at 0x7f4a79370af0>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:38:06.491720 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-14c54725-c668-43b7-a809-97cfb155e6d6 tempest-VolumesTestJSON-1337999319 tempest-VolumesTestJSON-1337999319-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.082625 Oct 28 12:38:06.492286 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 477/959] 10.222.0.62 () {58 vars in 1154 bytes} [Thu Oct 28 12:38:06 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:38:06.505109 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-04344a12-6a70-4145-948f-18e98fea7b5f tempest-VolumesTestJSON-1337999319 tempest-VolumesTestJSON-1337999319-project] Calling method '.version_select at 0x7f4a79462310>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:38:06.590417 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-04344a12-6a70-4145-948f-18e98fea7b5f tempest-VolumesTestJSON-1337999319 tempest-VolumesTestJSON-1337999319-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.090368 Oct 28 12:38:06.591065 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 483/960] 10.222.0.62 () {58 vars in 1187 bytes} [Thu Oct 28 12:38:06 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:38:06.604155 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-4e2a342a-779f-4bb3-9df4-7af83b6c5291 tempest-VolumesTestJSON-1337999319 tempest-VolumesTestJSON-1337999319-project] Calling method '.version_select at 0x7f4a79342700>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:38:06.684844 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-4e2a342a-779f-4bb3-9df4-7af83b6c5291 tempest-VolumesTestJSON-1337999319 tempest-VolumesTestJSON-1337999319-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084162 Oct 28 12:38:06.685424 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 478/961] 10.222.0.62 () {58 vars in 1154 bytes} [Thu Oct 28 12:38:06 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:38:07.402794 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-9293ec97-2156-4618-84f9-28733357ab38 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:38:07.403397 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-9293ec97-2156-4618-84f9-28733357ab38 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a6225d80-7446-4e30-89b9-b7b0551f5e35] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:38:07.409583 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9293ec97-2156-4618-84f9-28733357ab38 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:38:07.410035 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9293ec97-2156-4618-84f9-28733357ab38 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:38:07.410816 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9293ec97-2156-4618-84f9-28733357ab38 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:38:07.411247 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-9293ec97-2156-4618-84f9-28733357ab38 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:38:07.551302 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-9293ec97-2156-4618-84f9-28733357ab38 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:38:07.559156 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-9293ec97-2156-4618-84f9-28733357ab38 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35" status: 200 len: 1267 microversion: 2.1 time: 0.161801 Oct 28 12:38:07.560149 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 484/962] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:38:07 2021] GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:38:07.649672 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-c66f94ca-707a-4baa-8a54-a7d38acf0dcd req-e3b1e4ce-82ff-4573-879d-d370ae3e5249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6225d80-7446-4e30-89b9-b7b0551f5e35", "name": "network-vif-plugged", "status": "completed", "tag": "223ceb5a-9a7d-4a4d-8f6b-caa04ae0b0b0"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:38:07.652004 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:38:07.652004 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:38:07.660550 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-c66f94ca-707a-4baa-8a54-a7d38acf0dcd req-e3b1e4ce-82ff-4573-879d-d370ae3e5249 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:38:07.661607 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-c66f94ca-707a-4baa-8a54-a7d38acf0dcd req-e3b1e4ce-82ff-4573-879d-d370ae3e5249 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:38:07.672313 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-c66f94ca-707a-4baa-8a54-a7d38acf0dcd req-e3b1e4ce-82ff-4573-879d-d370ae3e5249 service nova] Creating event network-vif-plugged:223ceb5a-9a7d-4a4d-8f6b-caa04ae0b0b0 for instance a6225d80-7446-4e30-89b9-b7b0551f5e35 on hv-cinder-81514 Oct 28 12:38:07.679325 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-c66f94ca-707a-4baa-8a54-a7d38acf0dcd req-e3b1e4ce-82ff-4573-879d-d370ae3e5249 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034558 Oct 28 12:38:07.679928 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 479/963] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:38:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:38:08.576956 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-cf492618-86f3-4804-8e52-d4b84a48dd0b tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:38:08.577550 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-cf492618-86f3-4804-8e52-d4b84a48dd0b tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a6225d80-7446-4e30-89b9-b7b0551f5e35] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:38:08.584350 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-cf492618-86f3-4804-8e52-d4b84a48dd0b tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:38:08.584806 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-cf492618-86f3-4804-8e52-d4b84a48dd0b tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:38:08.585567 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-cf492618-86f3-4804-8e52-d4b84a48dd0b tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:38:08.585996 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-cf492618-86f3-4804-8e52-d4b84a48dd0b tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:38:08.718946 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-cf492618-86f3-4804-8e52-d4b84a48dd0b tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:38:08.726478 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-cf492618-86f3-4804-8e52-d4b84a48dd0b tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35" status: 200 len: 1267 microversion: 2.1 time: 0.153458 Oct 28 12:38:08.727047 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 485/964] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:38:08 2021] GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:38:09.745843 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-a4f67659-9462-4c51-a54e-ea5778947a38 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:38:09.746492 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-a4f67659-9462-4c51-a54e-ea5778947a38 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a6225d80-7446-4e30-89b9-b7b0551f5e35] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:38:09.753253 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a4f67659-9462-4c51-a54e-ea5778947a38 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:38:09.753682 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a4f67659-9462-4c51-a54e-ea5778947a38 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:38:09.754445 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a4f67659-9462-4c51-a54e-ea5778947a38 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:38:09.754863 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a4f67659-9462-4c51-a54e-ea5778947a38 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:38:09.897193 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-a4f67659-9462-4c51-a54e-ea5778947a38 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:38:09.908500 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-a4f67659-9462-4c51-a54e-ea5778947a38 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35" status: 200 len: 1453 microversion: 2.1 time: 0.167309 Oct 28 12:38:09.909298 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 480/965] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:38:09 2021] GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35 => generated 1453 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:38:09.929358 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-a9dc3431-baf1-43ea-b2fe-a8c465375422 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:38:09.929999 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-a9dc3431-baf1-43ea-b2fe-a8c465375422 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a6225d80-7446-4e30-89b9-b7b0551f5e35] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:38:09.937095 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a9dc3431-baf1-43ea-b2fe-a8c465375422 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:38:09.937649 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a9dc3431-baf1-43ea-b2fe-a8c465375422 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:38:09.938458 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a9dc3431-baf1-43ea-b2fe-a8c465375422 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:38:09.938892 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a9dc3431-baf1-43ea-b2fe-a8c465375422 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:38:10.065275 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-a9dc3431-baf1-43ea-b2fe-a8c465375422 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:38:10.073306 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-a9dc3431-baf1-43ea-b2fe-a8c465375422 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35" status: 200 len: 1453 microversion: 2.1 time: 0.148054 Oct 28 12:38:10.073910 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 486/966] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:38:09 2021] GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35 => generated 1453 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:38:12.117739 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-8c6d7122-a816-4cc3-9f2f-b2a95a9a48cb req-3b92ebc4-c65c-421c-b485-8d00b9d37ecc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6225d80-7446-4e30-89b9-b7b0551f5e35", "tag": "223ceb5a-9a7d-4a4d-8f6b-caa04ae0b0b0"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:38:12.120697 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:38:12.120697 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:38:12.131182 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-8c6d7122-a816-4cc3-9f2f-b2a95a9a48cb req-3b92ebc4-c65c-421c-b485-8d00b9d37ecc service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:38:12.131797 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-8c6d7122-a816-4cc3-9f2f-b2a95a9a48cb req-3b92ebc4-c65c-421c-b485-8d00b9d37ecc service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:38:12.156068 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-8c6d7122-a816-4cc3-9f2f-b2a95a9a48cb req-3b92ebc4-c65c-421c-b485-8d00b9d37ecc service nova] Creating event network-changed:223ceb5a-9a7d-4a4d-8f6b-caa04ae0b0b0 for instance a6225d80-7446-4e30-89b9-b7b0551f5e35 on hv-cinder-81514 Oct 28 12:38:12.165143 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-8c6d7122-a816-4cc3-9f2f-b2a95a9a48cb req-3b92ebc4-c65c-421c-b485-8d00b9d37ecc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052372 Oct 28 12:38:12.169051 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 481/967] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:38:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:39:22.425883 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-b8dfca48-3dd2-4622-aebe-4b9555ab0e8e tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Action: 'create', calling method: .version_select at 0x7f4a79343c10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-872802021"}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:39:22.444951 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.quota [None req-b8dfca48-3dd2-4622-aebe-4b9555ab0e8e tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Getting quotas for project b0c86daf60914cc3b120db57c84e7a3b. Resources: {'key_pairs'} {{(pid=115877) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:39:22.449192 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.quota [None req-b8dfca48-3dd2-4622-aebe-4b9555ab0e8e tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Getting quotas for user acfa94737a344d44b39d62747687df61 and project b0c86daf60914cc3b120db57c84e7a3b. Resources: {'key_pairs'} {{(pid=115877) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:39:22.846828 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.quota [None req-b8dfca48-3dd2-4622-aebe-4b9555ab0e8e tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Getting quotas for project b0c86daf60914cc3b120db57c84e7a3b. Resources: {'key_pairs'} {{(pid=115877) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:39:22.850868 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.quota [None req-b8dfca48-3dd2-4622-aebe-4b9555ab0e8e tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Getting quotas for user acfa94737a344d44b39d62747687df61 and project b0c86daf60914cc3b120db57c84e7a3b. Resources: {'key_pairs'} {{(pid=115877) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:39:22.863740 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-b8dfca48-3dd2-4622-aebe-4b9555ab0e8e tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.442927 Oct 28 12:39:22.864321 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 487/968] 10.222.0.62 () {60 vars in 1157 bytes} [Thu Oct 28 12:39:22 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:39:22.976260 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-fa48fad3-5246-4cb5-a499-6c22c06acdb4 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1758537418", "imageRef": "ec4a7faf-eee8-4d78-b9fd-0daee55ce608", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-872802021", "networks": [{"uuid": "5bb54599-a498-4593-adc3-9d00522a9997"}]}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:39:23.028968 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.network.neutron [None req-fa48fad3-5246-4cb5-a499-6c22c06acdb4 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] validate_networks() for [('5bb54599-a498-4593-adc3-9d00522a9997', None, None, None, None, None)] {{(pid=115876) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:39:23.418313 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-fa48fad3-5246-4cb5-a499-6c22c06acdb4 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Flavor limits 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:39:23.418789 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-fa48fad3-5246-4cb5-a499-6c22c06acdb4 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Image limits 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:39:23.419255 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-fa48fad3-5246-4cb5-a499-6c22c06acdb4 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Flavor pref 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:39:23.419655 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-fa48fad3-5246-4cb5-a499-6c22c06acdb4 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Image pref 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:39:23.420062 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-fa48fad3-5246-4cb5-a499-6c22c06acdb4 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:39:23.430708 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fa48fad3-5246-4cb5-a499-6c22c06acdb4 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:23.431154 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fa48fad3-5246-4cb5-a499-6c22c06acdb4 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:23.431957 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fa48fad3-5246-4cb5-a499-6c22c06acdb4 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:23.432383 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fa48fad3-5246-4cb5-a499-6c22c06acdb4 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:23.449472 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-fa48fad3-5246-4cb5-a499-6c22c06acdb4 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Getting quotas for project b0c86daf60914cc3b120db57c84e7a3b. Resources: {'cores', 'instances', 'ram'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:39:23.453921 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-fa48fad3-5246-4cb5-a499-6c22c06acdb4 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Getting quotas for user acfa94737a344d44b39d62747687df61 and project b0c86daf60914cc3b120db57c84e7a3b. Resources: {'cores', 'instances', 'ram'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:39:23.465746 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-fa48fad3-5246-4cb5-a499-6c22c06acdb4 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Going to run 1 instances... {{(pid=115876) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:39:23.468294 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-fa48fad3-5246-4cb5-a499-6c22c06acdb4 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ec4a7faf-eee8-4d78-b9fd-0daee55ce608',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:39:23.518421 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-fa48fad3-5246-4cb5-a499-6c22c06acdb4 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.547074 Oct 28 12:39:23.519360 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 482/969] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Oct 28 12:39:22 2021] POST /compute/v2.1/servers => generated 380 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 12:39:23.531265 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-eeb77317-20c0-4f4b-a9b6-207552677667 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:39:23.531836 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-eeb77317-20c0-4f4b-a9b6-207552677667 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:39:23.601536 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-eeb77317-20c0-4f4b-a9b6-207552677667 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:39:23.608505 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-eeb77317-20c0-4f4b-a9b6-207552677667 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1258 microversion: 2.1 time: 0.082688 Oct 28 12:39:23.609102 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 488/970] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:39:23 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1258 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:39:24.628011 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-292403b3-a164-48c8-bc64-4f983a902995 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:39:24.628937 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-292403b3-a164-48c8-bc64-4f983a902995 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:39:24.636330 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-292403b3-a164-48c8-bc64-4f983a902995 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:24.636846 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-292403b3-a164-48c8-bc64-4f983a902995 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:24.638073 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-292403b3-a164-48c8-bc64-4f983a902995 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:24.638568 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-292403b3-a164-48c8-bc64-4f983a902995 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:24.917771 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-292403b3-a164-48c8-bc64-4f983a902995 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:39:24.926478 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-292403b3-a164-48c8-bc64-4f983a902995 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1316 microversion: 2.1 time: 0.302424 Oct 28 12:39:24.927359 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 483/971] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:39:24 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1316 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:39:25.946788 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-1c7350f1-bfd4-4d8b-87e9-fdf0077ce42c tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:39:25.947335 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-1c7350f1-bfd4-4d8b-87e9-fdf0077ce42c tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:39:25.956896 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1c7350f1-bfd4-4d8b-87e9-fdf0077ce42c tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:25.957552 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1c7350f1-bfd4-4d8b-87e9-fdf0077ce42c tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:25.958700 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1c7350f1-bfd4-4d8b-87e9-fdf0077ce42c tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:25.959601 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1c7350f1-bfd4-4d8b-87e9-fdf0077ce42c tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:26.101610 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-1c7350f1-bfd4-4d8b-87e9-fdf0077ce42c tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:39:26.110196 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-1c7350f1-bfd4-4d8b-87e9-fdf0077ce42c tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1358 microversion: 2.1 time: 0.169368 Oct 28 12:39:26.120422 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 489/972] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:39:25 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:39:27.127325 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-52c6dfa8-2231-466d-9940-01123367edd1 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:39:27.127925 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-52c6dfa8-2231-466d-9940-01123367edd1 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:39:27.134370 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-52c6dfa8-2231-466d-9940-01123367edd1 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:27.134799 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-52c6dfa8-2231-466d-9940-01123367edd1 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:27.135535 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-52c6dfa8-2231-466d-9940-01123367edd1 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:27.135951 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-52c6dfa8-2231-466d-9940-01123367edd1 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:27.264922 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-52c6dfa8-2231-466d-9940-01123367edd1 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:39:27.272674 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-52c6dfa8-2231-466d-9940-01123367edd1 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1358 microversion: 2.1 time: 0.149080 Oct 28 12:39:27.273289 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 484/973] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:39:27 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:39:28.295004 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-82c6ec2e-2c97-4067-91a4-00434a0de442 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:39:28.296272 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-82c6ec2e-2c97-4067-91a4-00434a0de442 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:39:28.304210 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-82c6ec2e-2c97-4067-91a4-00434a0de442 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:28.304640 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-82c6ec2e-2c97-4067-91a4-00434a0de442 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:28.305457 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-82c6ec2e-2c97-4067-91a4-00434a0de442 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:28.305913 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-82c6ec2e-2c97-4067-91a4-00434a0de442 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:28.447088 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-82c6ec2e-2c97-4067-91a4-00434a0de442 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:39:28.458014 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-82c6ec2e-2c97-4067-91a4-00434a0de442 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1358 microversion: 2.1 time: 0.168160 Oct 28 12:39:28.458618 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 490/974] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:39:28 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:39:29.476263 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-32086593-272b-491a-95d9-0d36f3c90c7f tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:39:29.476960 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-32086593-272b-491a-95d9-0d36f3c90c7f tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:39:29.483708 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-32086593-272b-491a-95d9-0d36f3c90c7f tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:29.484127 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-32086593-272b-491a-95d9-0d36f3c90c7f tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:29.484994 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-32086593-272b-491a-95d9-0d36f3c90c7f tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:29.485417 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-32086593-272b-491a-95d9-0d36f3c90c7f tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:29.620785 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-32086593-272b-491a-95d9-0d36f3c90c7f tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:39:29.628674 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-32086593-272b-491a-95d9-0d36f3c90c7f tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1358 microversion: 2.1 time: 0.156296 Oct 28 12:39:29.629553 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 485/975] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:39:29 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:39:30.646055 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-e54995b4-cdc2-414b-8eaf-0422add4b565 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:39:30.646667 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-e54995b4-cdc2-414b-8eaf-0422add4b565 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:39:30.653511 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e54995b4-cdc2-414b-8eaf-0422add4b565 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:30.653962 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e54995b4-cdc2-414b-8eaf-0422add4b565 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:30.654734 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e54995b4-cdc2-414b-8eaf-0422add4b565 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:30.655166 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e54995b4-cdc2-414b-8eaf-0422add4b565 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:30.818852 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-e54995b4-cdc2-414b-8eaf-0422add4b565 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:39:30.827181 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-e54995b4-cdc2-414b-8eaf-0422add4b565 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1358 microversion: 2.1 time: 0.184929 Oct 28 12:39:30.828005 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 491/976] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:39:30 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:39:31.844305 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-6d7f57ac-2295-48b1-91c5-2fd087fb80e1 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:39:31.845115 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-6d7f57ac-2295-48b1-91c5-2fd087fb80e1 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:39:31.852082 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6d7f57ac-2295-48b1-91c5-2fd087fb80e1 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:31.852548 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6d7f57ac-2295-48b1-91c5-2fd087fb80e1 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:31.853346 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6d7f57ac-2295-48b1-91c5-2fd087fb80e1 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:31.853759 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-6d7f57ac-2295-48b1-91c5-2fd087fb80e1 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:31.984902 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-6d7f57ac-2295-48b1-91c5-2fd087fb80e1 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:39:31.992355 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-6d7f57ac-2295-48b1-91c5-2fd087fb80e1 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1358 microversion: 2.1 time: 0.152112 Oct 28 12:39:31.993162 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 486/977] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:39:31 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:39:33.009008 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-a2bb297a-8fe9-41f4-9c37-1c884e574932 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:39:33.010380 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-a2bb297a-8fe9-41f4-9c37-1c884e574932 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:39:33.017448 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a2bb297a-8fe9-41f4-9c37-1c884e574932 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:33.017930 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a2bb297a-8fe9-41f4-9c37-1c884e574932 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:33.019006 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a2bb297a-8fe9-41f4-9c37-1c884e574932 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:33.019529 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a2bb297a-8fe9-41f4-9c37-1c884e574932 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:33.148209 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-a2bb297a-8fe9-41f4-9c37-1c884e574932 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:39:33.156763 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-a2bb297a-8fe9-41f4-9c37-1c884e574932 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1358 microversion: 2.1 time: 0.151306 Oct 28 12:39:33.157350 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 492/978] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:39:33 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:39:34.175292 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-fe436340-39a8-4ab1-9b45-067fdf75431a tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:39:34.175894 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-fe436340-39a8-4ab1-9b45-067fdf75431a tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:39:34.182458 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fe436340-39a8-4ab1-9b45-067fdf75431a tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:34.182894 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fe436340-39a8-4ab1-9b45-067fdf75431a tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:34.183680 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fe436340-39a8-4ab1-9b45-067fdf75431a tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:34.184108 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fe436340-39a8-4ab1-9b45-067fdf75431a tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:34.310848 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-fe436340-39a8-4ab1-9b45-067fdf75431a tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:39:34.318474 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-fe436340-39a8-4ab1-9b45-067fdf75431a tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1358 microversion: 2.1 time: 0.147451 Oct 28 12:39:34.319048 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 487/979] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:39:34 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:39:35.335175 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-7b3be6dc-a004-4c90-b567-28277de5c28b tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:39:35.335773 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-7b3be6dc-a004-4c90-b567-28277de5c28b tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:39:35.342279 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7b3be6dc-a004-4c90-b567-28277de5c28b tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:35.342718 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7b3be6dc-a004-4c90-b567-28277de5c28b tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:35.343656 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7b3be6dc-a004-4c90-b567-28277de5c28b tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:35.343975 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7b3be6dc-a004-4c90-b567-28277de5c28b tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:35.484734 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-7b3be6dc-a004-4c90-b567-28277de5c28b tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:39:35.492517 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-7b3be6dc-a004-4c90-b567-28277de5c28b tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1358 microversion: 2.1 time: 0.161129 Oct 28 12:39:35.493126 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 493/980] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:39:35 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:39:36.511656 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-aca47cde-4766-491e-90a4-1eb4861cd9aa tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:39:36.512261 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-aca47cde-4766-491e-90a4-1eb4861cd9aa tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:39:36.519135 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-aca47cde-4766-491e-90a4-1eb4861cd9aa tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:36.519650 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-aca47cde-4766-491e-90a4-1eb4861cd9aa tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:36.520424 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-aca47cde-4766-491e-90a4-1eb4861cd9aa tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:36.520892 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-aca47cde-4766-491e-90a4-1eb4861cd9aa tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:36.744894 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-aca47cde-4766-491e-90a4-1eb4861cd9aa tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:39:36.752563 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-aca47cde-4766-491e-90a4-1eb4861cd9aa tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1358 microversion: 2.1 time: 0.244609 Oct 28 12:39:36.753297 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 488/981] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:39:36 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:39:36.870253 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-e88e2c2f-063f-423b-a2a7-523c0f5b4e13 req-ddcf3971-d931-4abc-ab5f-60d057d16063 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1", "tag": "29368d97-129c-41f1-b476-6e9c1655e8e5"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:39:36.872126 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:39:36.872126 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:39:36.880520 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-e88e2c2f-063f-423b-a2a7-523c0f5b4e13 req-ddcf3971-d931-4abc-ab5f-60d057d16063 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:36.886102 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-e88e2c2f-063f-423b-a2a7-523c0f5b4e13 req-ddcf3971-d931-4abc-ab5f-60d057d16063 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:36.900046 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-e88e2c2f-063f-423b-a2a7-523c0f5b4e13 req-ddcf3971-d931-4abc-ab5f-60d057d16063 service nova] Creating event network-changed:29368d97-129c-41f1-b476-6e9c1655e8e5 for instance ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 on hv-cinder-81514 Oct 28 12:39:36.908735 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-e88e2c2f-063f-423b-a2a7-523c0f5b4e13 req-ddcf3971-d931-4abc-ab5f-60d057d16063 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042035 Oct 28 12:39:36.909359 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 494/982] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:39:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:39:37.770294 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-b383e256-a583-432a-86dc-d592f4a83e32 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:39:37.771025 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-b383e256-a583-432a-86dc-d592f4a83e32 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:39:37.777885 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b383e256-a583-432a-86dc-d592f4a83e32 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:37.778316 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b383e256-a583-432a-86dc-d592f4a83e32 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:37.779074 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b383e256-a583-432a-86dc-d592f4a83e32 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:37.779480 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-b383e256-a583-432a-86dc-d592f4a83e32 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:37.905787 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-b383e256-a583-432a-86dc-d592f4a83e32 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:39:37.913663 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-b383e256-a583-432a-86dc-d592f4a83e32 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1358 microversion: 2.1 time: 0.147238 Oct 28 12:39:37.914220 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 489/983] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:39:37 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:39:38.931462 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-432a771a-8319-4c38-85be-cc49a2a2027c tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:39:38.932127 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-432a771a-8319-4c38-85be-cc49a2a2027c tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:39:38.938820 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-432a771a-8319-4c38-85be-cc49a2a2027c tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:38.939264 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-432a771a-8319-4c38-85be-cc49a2a2027c tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:38.940025 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-432a771a-8319-4c38-85be-cc49a2a2027c tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:38.940462 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-432a771a-8319-4c38-85be-cc49a2a2027c tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:39.066144 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-432a771a-8319-4c38-85be-cc49a2a2027c tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:39:39.074179 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-432a771a-8319-4c38-85be-cc49a2a2027c tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1358 microversion: 2.1 time: 0.147459 Oct 28 12:39:39.074752 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 495/984] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:39:38 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:39:40.092562 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-dcc93afd-9b2c-436d-ac5c-b7ba6b5c49e8 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:39:40.093331 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-dcc93afd-9b2c-436d-ac5c-b7ba6b5c49e8 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:39:40.100323 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-dcc93afd-9b2c-436d-ac5c-b7ba6b5c49e8 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:40.100807 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-dcc93afd-9b2c-436d-ac5c-b7ba6b5c49e8 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:40.101549 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-dcc93afd-9b2c-436d-ac5c-b7ba6b5c49e8 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:40.102003 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-dcc93afd-9b2c-436d-ac5c-b7ba6b5c49e8 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:40.246959 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-dcc93afd-9b2c-436d-ac5c-b7ba6b5c49e8 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:39:40.254654 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-dcc93afd-9b2c-436d-ac5c-b7ba6b5c49e8 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1358 microversion: 2.1 time: 0.166930 Oct 28 12:39:40.255205 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 490/985] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:39:40 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:39:41.271746 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-35873efd-c05f-4bd4-a890-2a14fec998bf tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:39:41.272347 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-35873efd-c05f-4bd4-a890-2a14fec998bf tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:39:41.278732 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-35873efd-c05f-4bd4-a890-2a14fec998bf tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:41.279151 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-35873efd-c05f-4bd4-a890-2a14fec998bf tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:41.279921 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-35873efd-c05f-4bd4-a890-2a14fec998bf tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:41.280340 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-35873efd-c05f-4bd4-a890-2a14fec998bf tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:41.404647 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-35873efd-c05f-4bd4-a890-2a14fec998bf tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:39:41.412298 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-35873efd-c05f-4bd4-a890-2a14fec998bf tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1358 microversion: 2.1 time: 0.144356 Oct 28 12:39:41.412882 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 496/986] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:39:41 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:39:42.430607 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-06edad55-9233-482a-9e3c-05c34ca95830 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:39:42.431336 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-06edad55-9233-482a-9e3c-05c34ca95830 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:39:42.438700 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-06edad55-9233-482a-9e3c-05c34ca95830 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:42.439362 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-06edad55-9233-482a-9e3c-05c34ca95830 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:42.440214 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-06edad55-9233-482a-9e3c-05c34ca95830 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:42.440643 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-06edad55-9233-482a-9e3c-05c34ca95830 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:42.585460 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-06edad55-9233-482a-9e3c-05c34ca95830 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:39:42.594449 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-06edad55-9233-482a-9e3c-05c34ca95830 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1358 microversion: 2.1 time: 0.168369 Oct 28 12:39:42.595225 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 491/987] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:39:42 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:39:42.835705 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-5845f820-1428-487f-8ac6-61c0f8889f4c req-ca89a7d2-9693-4720-8800-9388ec9db244 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1", "name": "network-vif-plugged", "status": "completed", "tag": "29368d97-129c-41f1-b476-6e9c1655e8e5"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:39:42.837375 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:39:42.837375 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:39:42.845501 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-5845f820-1428-487f-8ac6-61c0f8889f4c req-ca89a7d2-9693-4720-8800-9388ec9db244 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:42.845767 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-5845f820-1428-487f-8ac6-61c0f8889f4c req-ca89a7d2-9693-4720-8800-9388ec9db244 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:42.857609 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-5845f820-1428-487f-8ac6-61c0f8889f4c req-ca89a7d2-9693-4720-8800-9388ec9db244 service nova] Creating event network-vif-plugged:29368d97-129c-41f1-b476-6e9c1655e8e5 for instance ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 on hv-cinder-81514 Oct 28 12:39:42.862691 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-5845f820-1428-487f-8ac6-61c0f8889f4c req-ca89a7d2-9693-4720-8800-9388ec9db244 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031857 Oct 28 12:39:42.863302 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 497/988] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:39:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:39:43.613798 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-f4a97ba0-4a1e-40a0-ad55-fe66fde839fd tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:39:43.614584 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-f4a97ba0-4a1e-40a0-ad55-fe66fde839fd tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:39:43.623027 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f4a97ba0-4a1e-40a0-ad55-fe66fde839fd tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:43.623608 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f4a97ba0-4a1e-40a0-ad55-fe66fde839fd tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:43.624416 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f4a97ba0-4a1e-40a0-ad55-fe66fde839fd tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:43.624889 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f4a97ba0-4a1e-40a0-ad55-fe66fde839fd tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:43.753260 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f4a97ba0-4a1e-40a0-ad55-fe66fde839fd tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:39:43.761018 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-f4a97ba0-4a1e-40a0-ad55-fe66fde839fd tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1358 microversion: 2.1 time: 0.152094 Oct 28 12:39:43.761590 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 492/989] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:39:43 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:39:44.779301 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-08e4a176-5126-4d32-9d4c-9f127ce998eb tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:39:44.779959 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-08e4a176-5126-4d32-9d4c-9f127ce998eb tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:39:44.786981 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-08e4a176-5126-4d32-9d4c-9f127ce998eb tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:44.787416 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-08e4a176-5126-4d32-9d4c-9f127ce998eb tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:44.788178 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-08e4a176-5126-4d32-9d4c-9f127ce998eb tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:44.788601 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-08e4a176-5126-4d32-9d4c-9f127ce998eb tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:44.919710 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-08e4a176-5126-4d32-9d4c-9f127ce998eb tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:39:44.927964 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-08e4a176-5126-4d32-9d4c-9f127ce998eb tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1547 microversion: 2.1 time: 0.153265 Oct 28 12:39:44.928562 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 498/990] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:39:44 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:39:44.944497 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-7b96357f-bb16-4894-b5a6-3870a9923211 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:39:44.945144 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-7b96357f-bb16-4894-b5a6-3870a9923211 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:39:44.951426 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7b96357f-bb16-4894-b5a6-3870a9923211 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:44.951848 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7b96357f-bb16-4894-b5a6-3870a9923211 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:44.952603 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7b96357f-bb16-4894-b5a6-3870a9923211 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:44.953213 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7b96357f-bb16-4894-b5a6-3870a9923211 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:45.080143 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-7b96357f-bb16-4894-b5a6-3870a9923211 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:39:45.088364 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-7b96357f-bb16-4894-b5a6-3870a9923211 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1547 microversion: 2.1 time: 0.147583 Oct 28 12:39:45.089016 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 493/991] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:39:44 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:39:45.105832 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-d9857812-f8b6-4571-99f1-bfa9708c8d07 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:39:45.110695 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:39:45.110695 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:39:45.111851 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-d9857812-f8b6-4571-99f1-bfa9708c8d07 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:39:45.112774 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-d9857812-f8b6-4571-99f1-bfa9708c8d07 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Searching by: {'deleted': False, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b'} {{(pid=115877) get_all /opt/stack/nova/nova/compute/api.py:2905}} Oct 28 12:39:45.121725 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d9857812-f8b6-4571-99f1-bfa9708c8d07 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:45.122340 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d9857812-f8b6-4571-99f1-bfa9708c8d07 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:45.123560 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d9857812-f8b6-4571-99f1-bfa9708c8d07 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:45.124185 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d9857812-f8b6-4571-99f1-bfa9708c8d07 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:45.215473 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.multi_cell_list [None req-d9857812-f8b6-4571-99f1-bfa9708c8d07 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=115877) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Oct 28 12:39:45.317150 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-d9857812-f8b6-4571-99f1-bfa9708c8d07 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.216311 Oct 28 12:39:45.317633 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 499/992] 10.222.0.62 () {58 vars in 1124 bytes} [Thu Oct 28 12:39:45 2021] GET /compute/v2.1/servers => generated 343 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:39:45.329580 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-a1953973-6fad-480b-b858-dd1fdd3fb456 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:39:45.330445 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-a1953973-6fad-480b-b858-dd1fdd3fb456 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:39:45.338577 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a1953973-6fad-480b-b858-dd1fdd3fb456 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:45.339125 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a1953973-6fad-480b-b858-dd1fdd3fb456 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:45.340225 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a1953973-6fad-480b-b858-dd1fdd3fb456 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:45.340780 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a1953973-6fad-480b-b858-dd1fdd3fb456 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:45.474016 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-a1953973-6fad-480b-b858-dd1fdd3fb456 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:39:45.484316 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-a1953973-6fad-480b-b858-dd1fdd3fb456 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1547 microversion: 2.1 time: 0.159585 Oct 28 12:39:45.485102 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 494/993] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:39:45 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:39:46.985777 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-46b7d841-e97d-48f2-8491-030f8e58f305 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81b21938-73ac-4c20-9a2f-c086f86f33ae"}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:39:46.986828 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-46b7d841-e97d-48f2-8491-030f8e58f305 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:39:46.993892 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-46b7d841-e97d-48f2-8491-030f8e58f305 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:46.994346 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-46b7d841-e97d-48f2-8491-030f8e58f305 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:46.995116 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-46b7d841-e97d-48f2-8491-030f8e58f305 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:46.995580 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-46b7d841-e97d-48f2-8491-030f8e58f305 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:47.409619 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-46b7d841-e97d-48f2-8491-030f8e58f305 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "POST /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.427305 Oct 28 12:39:47.410156 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 500/994] 10.222.0.62 () {60 vars in 1322 bytes} [Thu Oct 28 12:39:46 2021] POST /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1/os-volume_attachments => generated 194 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:39:53.886771 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-150e66ae-5200-4d05-a417-f2bb22b9fe9e tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:39:53.887369 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-150e66ae-5200-4d05-a417-f2bb22b9fe9e tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a6225d80-7446-4e30-89b9-b7b0551f5e35] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:39:53.895234 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-150e66ae-5200-4d05-a417-f2bb22b9fe9e tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:53.895744 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-150e66ae-5200-4d05-a417-f2bb22b9fe9e tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:53.897147 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-150e66ae-5200-4d05-a417-f2bb22b9fe9e tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:53.897965 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-150e66ae-5200-4d05-a417-f2bb22b9fe9e tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:53.927968 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-150e66ae-5200-4d05-a417-f2bb22b9fe9e tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a6225d80-7446-4e30-89b9-b7b0551f5e35] Going to try to terminate instance {{(pid=115876) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:39:54.013244 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-150e66ae-5200-4d05-a417-f2bb22b9fe9e tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35" status: 204 len: 0 microversion: 2.1 time: 0.132835 Oct 28 12:39:54.017094 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 495/995] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Oct 28 12:39:53 2021] DELETE /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:39:54.023324 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-29a895b4-54d6-44fd-bda2-987f747df49e tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:39:54.024034 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-29a895b4-54d6-44fd-bda2-987f747df49e tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a6225d80-7446-4e30-89b9-b7b0551f5e35] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:39:54.029971 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-29a895b4-54d6-44fd-bda2-987f747df49e tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:54.030410 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-29a895b4-54d6-44fd-bda2-987f747df49e tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:54.031213 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-29a895b4-54d6-44fd-bda2-987f747df49e tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:54.031640 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-29a895b4-54d6-44fd-bda2-987f747df49e tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:54.042497 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-be55e2e1-a14b-4965-93bf-646d22078da2 req-6ccd77d8-cf95-4168-8264-6b0f04b322b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6225d80-7446-4e30-89b9-b7b0551f5e35", "tag": "223ceb5a-9a7d-4a4d-8f6b-caa04ae0b0b0"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:39:54.044452 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:39:54.044452 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:39:54.053986 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-be55e2e1-a14b-4965-93bf-646d22078da2 req-6ccd77d8-cf95-4168-8264-6b0f04b322b2 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:54.054597 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-be55e2e1-a14b-4965-93bf-646d22078da2 req-6ccd77d8-cf95-4168-8264-6b0f04b322b2 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:54.066260 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-be55e2e1-a14b-4965-93bf-646d22078da2 req-6ccd77d8-cf95-4168-8264-6b0f04b322b2 service nova] Creating event network-changed:223ceb5a-9a7d-4a4d-8f6b-caa04ae0b0b0 for instance a6225d80-7446-4e30-89b9-b7b0551f5e35 on hv-cinder-81514 Oct 28 12:39:54.071646 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-be55e2e1-a14b-4965-93bf-646d22078da2 req-6ccd77d8-cf95-4168-8264-6b0f04b322b2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188533 Oct 28 12:39:54.072795 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 501/996] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:39:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:39:54.256053 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-29a895b4-54d6-44fd-bda2-987f747df49e tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:39:54.264534 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-29a895b4-54d6-44fd-bda2-987f747df49e tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35" status: 200 len: 1577 microversion: 2.1 time: 0.245969 Oct 28 12:39:54.265358 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 496/997] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:39:54 2021] GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35 => generated 1577 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:39:55.284868 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-fc25226a-8dc6-46a7-90a2-0927f50d3751 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:39:55.285547 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-fc25226a-8dc6-46a7-90a2-0927f50d3751 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a6225d80-7446-4e30-89b9-b7b0551f5e35] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:39:55.292341 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fc25226a-8dc6-46a7-90a2-0927f50d3751 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:55.292807 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fc25226a-8dc6-46a7-90a2-0927f50d3751 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:55.293582 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fc25226a-8dc6-46a7-90a2-0927f50d3751 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:55.294013 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fc25226a-8dc6-46a7-90a2-0927f50d3751 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:55.428426 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-fc25226a-8dc6-46a7-90a2-0927f50d3751 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:39:55.437956 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-fc25226a-8dc6-46a7-90a2-0927f50d3751 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35" status: 200 len: 1459 microversion: 2.1 time: 0.158018 Oct 28 12:39:55.438515 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 502/998] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:39:55 2021] GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35 => generated 1459 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:39:56.456521 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-7b646eed-7ac8-43c8-836b-fe61ad8baba8 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:39:56.457709 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-7b646eed-7ac8-43c8-836b-fe61ad8baba8 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a6225d80-7446-4e30-89b9-b7b0551f5e35] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:39:56.463608 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7b646eed-7ac8-43c8-836b-fe61ad8baba8 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:56.464072 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7b646eed-7ac8-43c8-836b-fe61ad8baba8 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:56.464870 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7b646eed-7ac8-43c8-836b-fe61ad8baba8 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:56.465298 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7b646eed-7ac8-43c8-836b-fe61ad8baba8 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:56.594663 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-7b646eed-7ac8-43c8-836b-fe61ad8baba8 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:39:56.602652 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-7b646eed-7ac8-43c8-836b-fe61ad8baba8 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35" status: 200 len: 1459 microversion: 2.1 time: 0.150504 Oct 28 12:39:56.603238 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 497/999] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:39:56 2021] GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35 => generated 1459 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:39:57.619842 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-e484bf1a-8122-4033-b733-d455296ba11a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:39:57.620419 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-e484bf1a-8122-4033-b733-d455296ba11a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a6225d80-7446-4e30-89b9-b7b0551f5e35] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:39:57.627755 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e484bf1a-8122-4033-b733-d455296ba11a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:57.628195 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e484bf1a-8122-4033-b733-d455296ba11a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:57.629034 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e484bf1a-8122-4033-b733-d455296ba11a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:57.629468 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e484bf1a-8122-4033-b733-d455296ba11a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:57.752027 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-e484bf1a-8122-4033-b733-d455296ba11a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:39:57.761529 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-e484bf1a-8122-4033-b733-d455296ba11a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35" status: 200 len: 1459 microversion: 2.1 time: 0.145350 Oct 28 12:39:57.762276 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 503/1000] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:39:57 2021] GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35 => generated 1459 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:39:58.779062 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-3672d412-f38b-4bdd-b325-d75412a4a45a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:39:58.779806 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-3672d412-f38b-4bdd-b325-d75412a4a45a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a6225d80-7446-4e30-89b9-b7b0551f5e35] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:39:58.785604 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-6f43605c-8e22-4889-a3db-ccaa0836e322 req-37a0bf74-adc1-4422-aa03-171773ea7310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6225d80-7446-4e30-89b9-b7b0551f5e35", "name": "network-vif-deleted", "tag": "223ceb5a-9a7d-4a4d-8f6b-caa04ae0b0b0"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:39:58.788010 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:39:58.788010 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:39:58.788565 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3672d412-f38b-4bdd-b325-d75412a4a45a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:58.789208 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3672d412-f38b-4bdd-b325-d75412a4a45a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:58.790003 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3672d412-f38b-4bdd-b325-d75412a4a45a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:58.790448 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3672d412-f38b-4bdd-b325-d75412a4a45a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:58.804078 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-6f43605c-8e22-4889-a3db-ccaa0836e322 req-37a0bf74-adc1-4422-aa03-171773ea7310 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:58.805892 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-6f43605c-8e22-4889-a3db-ccaa0836e322 req-37a0bf74-adc1-4422-aa03-171773ea7310 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:58.820137 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-6f43605c-8e22-4889-a3db-ccaa0836e322 req-37a0bf74-adc1-4422-aa03-171773ea7310 service nova] Creating event network-vif-deleted:223ceb5a-9a7d-4a4d-8f6b-caa04ae0b0b0 for instance a6225d80-7446-4e30-89b9-b7b0551f5e35 on hv-cinder-81514 Oct 28 12:39:58.826383 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-6f43605c-8e22-4889-a3db-ccaa0836e322 req-37a0bf74-adc1-4422-aa03-171773ea7310 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045053 Oct 28 12:39:58.827391 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 504/1001] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:39:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:39:58.880650 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-3672d412-f38b-4bdd-b325-d75412a4a45a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:39:58.889843 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-3672d412-f38b-4bdd-b325-d75412a4a45a tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35" status: 200 len: 1391 microversion: 2.1 time: 0.115298 Oct 28 12:39:58.890422 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 498/1002] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:39:58 2021] GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35 => generated 1391 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:39:59.173164 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-7ff2a528-e992-48b8-ad58-c8b0b88a8017 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:39:59.173938 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-7ff2a528-e992-48b8-ad58-c8b0b88a8017 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:39:59.180985 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7ff2a528-e992-48b8-ad58-c8b0b88a8017 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:59.181423 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7ff2a528-e992-48b8-ad58-c8b0b88a8017 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:59.182287 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7ff2a528-e992-48b8-ad58-c8b0b88a8017 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:59.182790 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7ff2a528-e992-48b8-ad58-c8b0b88a8017 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:59.314795 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-7ff2a528-e992-48b8-ad58-c8b0b88a8017 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:39:59.323328 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-7ff2a528-e992-48b8-ad58-c8b0b88a8017 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1593 microversion: 2.1 time: 0.154769 Oct 28 12:39:59.323898 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 505/1003] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:39:59 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1593 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:39:59.906788 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-fd4da5ca-e618-4ce0-aa4c-b4990d293259 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:39:59.907412 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-fd4da5ca-e618-4ce0-aa4c-b4990d293259 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a6225d80-7446-4e30-89b9-b7b0551f5e35] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:39:59.914228 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fd4da5ca-e618-4ce0-aa4c-b4990d293259 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:59.914661 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fd4da5ca-e618-4ce0-aa4c-b4990d293259 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:59.915432 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fd4da5ca-e618-4ce0-aa4c-b4990d293259 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:39:59.915853 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fd4da5ca-e618-4ce0-aa4c-b4990d293259 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:39:59.930997 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.wsgi [None req-fd4da5ca-e618-4ce0-aa4c-b4990d293259 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] HTTP exception thrown: Instance a6225d80-7446-4e30-89b9-b7b0551f5e35 could not be found. Oct 28 12:39:59.931574 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-fd4da5ca-e618-4ce0-aa4c-b4990d293259 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Returning 404 to user: Instance a6225d80-7446-4e30-89b9-b7b0551f5e35 could not be found. {{(pid=115876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:39:59.932435 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-fd4da5ca-e618-4ce0-aa4c-b4990d293259 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35" status: 404 len: 111 microversion: 2.1 time: 0.029705 Oct 28 12:39:59.933041 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 499/1004] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:39:59 2021] GET /compute/v2.1/servers/a6225d80-7446-4e30-89b9-b7b0551f5e35 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:40:01.241154 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-88192397-17b4-46fd-9cf3-594102550de5 req-10632328-8bc8-4fac-a0a4-4ad03eb5a2be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1", "tag": "29368d97-129c-41f1-b476-6e9c1655e8e5"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:40:01.242843 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:40:01.242843 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:40:01.250801 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-88192397-17b4-46fd-9cf3-594102550de5 req-10632328-8bc8-4fac-a0a4-4ad03eb5a2be service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:01.251332 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-88192397-17b4-46fd-9cf3-594102550de5 req-10632328-8bc8-4fac-a0a4-4ad03eb5a2be service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:01.264294 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-88192397-17b4-46fd-9cf3-594102550de5 req-10632328-8bc8-4fac-a0a4-4ad03eb5a2be service nova] Creating event network-changed:29368d97-129c-41f1-b476-6e9c1655e8e5 for instance ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 on hv-cinder-81514 Oct 28 12:40:01.270344 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-88192397-17b4-46fd-9cf3-594102550de5 req-10632328-8bc8-4fac-a0a4-4ad03eb5a2be service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033131 Oct 28 12:40:01.271046 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 506/1005] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:40:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:40:02.285481 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-3ce5b416-529c-4336-a029-ff3a5919d655 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1512310625"}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:40:02.287344 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-3ce5b416-529c-4336-a029-ff3a5919d655 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:40:02.297522 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3ce5b416-529c-4336-a029-ff3a5919d655 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:02.298245 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3ce5b416-529c-4336-a029-ff3a5919d655 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:02.299226 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3ce5b416-529c-4336-a029-ff3a5919d655 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:02.299851 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3ce5b416-529c-4336-a029-ff3a5919d655 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:02.431873 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.network.security_group_api [None req-3ce5b416-529c-4336-a029-ff3a5919d655 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Adding security group ba8386f8-3feb-4b39-8b70-06f88e039ea1 to port 29368d97-129c-41f1-b476-6e9c1655e8e5 Oct 28 12:40:02.811744 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-3ce5b416-529c-4336-a029-ff3a5919d655 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "POST /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1/action" status: 202 len: 0 microversion: 2.1 time: 0.531329 Oct 28 12:40:02.814043 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 500/1006] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:40:02 2021] POST /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1/action => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:40:02.823057 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-065c30b1-722f-4284-a7c0-ba6cf7662924 req-b6f9c48e-aa33-4fc1-adfc-e4786895b52a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1", "tag": "29368d97-129c-41f1-b476-6e9c1655e8e5"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:40:02.824576 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:40:02.824576 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:40:02.831228 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-e04466bd-da2a-47e0-8f91-ba669b6c721a tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:40:02.832301 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-e04466bd-da2a-47e0-8f91-ba669b6c721a tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:40:02.836122 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-065c30b1-722f-4284-a7c0-ba6cf7662924 req-b6f9c48e-aa33-4fc1-adfc-e4786895b52a service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:02.838571 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-065c30b1-722f-4284-a7c0-ba6cf7662924 req-b6f9c48e-aa33-4fc1-adfc-e4786895b52a service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:02.850845 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e04466bd-da2a-47e0-8f91-ba669b6c721a tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:02.852697 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e04466bd-da2a-47e0-8f91-ba669b6c721a tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:02.853696 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e04466bd-da2a-47e0-8f91-ba669b6c721a tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:02.855144 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e04466bd-da2a-47e0-8f91-ba669b6c721a tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:02.862707 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-065c30b1-722f-4284-a7c0-ba6cf7662924 req-b6f9c48e-aa33-4fc1-adfc-e4786895b52a service nova] Creating event network-changed:29368d97-129c-41f1-b476-6e9c1655e8e5 for instance ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 on hv-cinder-81514 Oct 28 12:40:02.871872 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-065c30b1-722f-4284-a7c0-ba6cf7662924 req-b6f9c48e-aa33-4fc1-adfc-e4786895b52a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053190 Oct 28 12:40:02.872661 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 507/1007] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:40:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:40:03.089064 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-e04466bd-da2a-47e0-8f91-ba669b6c721a tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:40:03.104988 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-e04466bd-da2a-47e0-8f91-ba669b6c721a tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1759 microversion: 2.1 time: 0.279147 Oct 28 12:40:03.105810 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 501/1008] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:40:02 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1759 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:40:03.179171 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-d0f78e61-ccf7-483b-a52f-43e64234a3a9 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:40:03.179755 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-d0f78e61-ccf7-483b-a52f-43e64234a3a9 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: b81a4bfc-220f-4a70-b4a8-8da612c927fb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:40:03.187040 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d0f78e61-ccf7-483b-a52f-43e64234a3a9 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:03.187763 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d0f78e61-ccf7-483b-a52f-43e64234a3a9 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:03.188544 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d0f78e61-ccf7-483b-a52f-43e64234a3a9 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:03.189189 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d0f78e61-ccf7-483b-a52f-43e64234a3a9 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:03.217306 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-d0f78e61-ccf7-483b-a52f-43e64234a3a9 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: b81a4bfc-220f-4a70-b4a8-8da612c927fb] Going to try to terminate instance {{(pid=115877) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:40:03.288257 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-2e62a2fc-1aed-493d-af22-5cbfe653ee42 req-743dfaa0-ed18-4d7e-92d1-8ebe5d634820 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b81a4bfc-220f-4a70-b4a8-8da612c927fb", "tag": "a302007e-59e1-42c9-9b5a-9b428e8140c9"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:40:03.289908 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:40:03.289908 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:40:03.305034 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-2e62a2fc-1aed-493d-af22-5cbfe653ee42 req-743dfaa0-ed18-4d7e-92d1-8ebe5d634820 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:03.306901 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-2e62a2fc-1aed-493d-af22-5cbfe653ee42 req-743dfaa0-ed18-4d7e-92d1-8ebe5d634820 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:03.320075 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-d0f78e61-ccf7-483b-a52f-43e64234a3a9 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb" status: 204 len: 0 microversion: 2.1 time: 0.145020 Oct 28 12:40:03.321479 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 508/1009] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Oct 28 12:40:03 2021] DELETE /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:40:03.329425 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-2e62a2fc-1aed-493d-af22-5cbfe653ee42 req-743dfaa0-ed18-4d7e-92d1-8ebe5d634820 service nova] Creating event network-changed:a302007e-59e1-42c9-9b5a-9b428e8140c9 for instance b81a4bfc-220f-4a70-b4a8-8da612c927fb on hv-cinder-81514 Oct 28 12:40:03.330968 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-1808128a-7e62-423c-8fd9-6bbad5c4fc17 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:40:03.332635 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-1808128a-7e62-423c-8fd9-6bbad5c4fc17 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: b81a4bfc-220f-4a70-b4a8-8da612c927fb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:40:03.340230 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1808128a-7e62-423c-8fd9-6bbad5c4fc17 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:03.340848 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-2e62a2fc-1aed-493d-af22-5cbfe653ee42 req-743dfaa0-ed18-4d7e-92d1-8ebe5d634820 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056093 Oct 28 12:40:03.341664 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 502/1010] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:40:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:40:03.341862 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1808128a-7e62-423c-8fd9-6bbad5c4fc17 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:03.342745 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1808128a-7e62-423c-8fd9-6bbad5c4fc17 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:03.345016 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-1808128a-7e62-423c-8fd9-6bbad5c4fc17 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:03.594695 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-1808128a-7e62-423c-8fd9-6bbad5c4fc17 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:40:03.610507 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-1808128a-7e62-423c-8fd9-6bbad5c4fc17 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb" status: 200 len: 1577 microversion: 2.1 time: 0.284331 Oct 28 12:40:03.615930 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 509/1011] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:40:03 2021] GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb => generated 1577 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:40:04.631136 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-0899c122-096d-41d1-aef8-393b708766b3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:40:04.631825 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-0899c122-096d-41d1-aef8-393b708766b3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: b81a4bfc-220f-4a70-b4a8-8da612c927fb] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:40:04.647746 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-0899c122-096d-41d1-aef8-393b708766b3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:04.648456 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-0899c122-096d-41d1-aef8-393b708766b3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:04.649257 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-0899c122-096d-41d1-aef8-393b708766b3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:04.649686 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-0899c122-096d-41d1-aef8-393b708766b3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:04.783627 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-0899c122-096d-41d1-aef8-393b708766b3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:40:04.791670 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-0899c122-096d-41d1-aef8-393b708766b3 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb" status: 200 len: 1458 microversion: 2.1 time: 0.164719 Oct 28 12:40:04.792277 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 503/1012] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:40:04 2021] GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb => generated 1458 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:40:05.496243 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-f2c73fce-a406-4c4f-9c7e-c6623bef35b3 req-53ff8df4-bb0d-4273-84dd-65797590d62a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b81a4bfc-220f-4a70-b4a8-8da612c927fb", "name": "network-vif-deleted", "tag": "a302007e-59e1-42c9-9b5a-9b428e8140c9"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:40:05.497788 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:40:05.497788 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:40:05.505994 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-f2c73fce-a406-4c4f-9c7e-c6623bef35b3 req-53ff8df4-bb0d-4273-84dd-65797590d62a service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:05.510675 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-f2c73fce-a406-4c4f-9c7e-c6623bef35b3 req-53ff8df4-bb0d-4273-84dd-65797590d62a service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:05.521221 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-f2c73fce-a406-4c4f-9c7e-c6623bef35b3 req-53ff8df4-bb0d-4273-84dd-65797590d62a service nova] Creating event network-vif-deleted:a302007e-59e1-42c9-9b5a-9b428e8140c9 for instance b81a4bfc-220f-4a70-b4a8-8da612c927fb on hv-cinder-81514 Oct 28 12:40:05.528111 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-f2c73fce-a406-4c4f-9c7e-c6623bef35b3 req-53ff8df4-bb0d-4273-84dd-65797590d62a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035175 Oct 28 12:40:05.529305 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 510/1013] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:40:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:40:05.809247 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-15d718d4-8e0d-4f19-9fb1-5a95caa9e194 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:40:05.810806 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-15d718d4-8e0d-4f19-9fb1-5a95caa9e194 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: b81a4bfc-220f-4a70-b4a8-8da612c927fb] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:40:05.818852 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-15d718d4-8e0d-4f19-9fb1-5a95caa9e194 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:05.819294 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-15d718d4-8e0d-4f19-9fb1-5a95caa9e194 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:05.820074 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-15d718d4-8e0d-4f19-9fb1-5a95caa9e194 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:05.820502 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-15d718d4-8e0d-4f19-9fb1-5a95caa9e194 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:05.856615 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-15d718d4-8e0d-4f19-9fb1-5a95caa9e194 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:05.857435 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-15d718d4-8e0d-4f19-9fb1-5a95caa9e194 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:05.857935 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.objects.instance [None req-15d718d4-8e0d-4f19-9fb1-5a95caa9e194 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lazy-loading 'fault' on Instance uuid b81a4bfc-220f-4a70-b4a8-8da612c927fb {{(pid=115876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:40:05.900643 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-15d718d4-8e0d-4f19-9fb1-5a95caa9e194 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4303ee654346434cb52fa498176297b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a330da99234af6b3a80df822d5067f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:40:05.907316 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-15d718d4-8e0d-4f19-9fb1-5a95caa9e194 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb" status: 200 len: 1230 microversion: 2.1 time: 0.102283 Oct 28 12:40:05.907894 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 504/1014] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:40:05 2021] GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb => generated 1230 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:40:06.926305 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-d13b19cd-28da-4e16-b965-2677e5cbcfb7 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:40:06.927020 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-d13b19cd-28da-4e16-b965-2677e5cbcfb7 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: b81a4bfc-220f-4a70-b4a8-8da612c927fb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:40:06.933786 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d13b19cd-28da-4e16-b965-2677e5cbcfb7 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:06.934237 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d13b19cd-28da-4e16-b965-2677e5cbcfb7 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:06.935020 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d13b19cd-28da-4e16-b965-2677e5cbcfb7 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:06.935509 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d13b19cd-28da-4e16-b965-2677e5cbcfb7 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:06.949507 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.wsgi [None req-d13b19cd-28da-4e16-b965-2677e5cbcfb7 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] HTTP exception thrown: Instance b81a4bfc-220f-4a70-b4a8-8da612c927fb could not be found. Oct 28 12:40:06.950032 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-d13b19cd-28da-4e16-b965-2677e5cbcfb7 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Returning 404 to user: Instance b81a4bfc-220f-4a70-b4a8-8da612c927fb could not be found. {{(pid=115877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:40:06.950879 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-d13b19cd-28da-4e16-b965-2677e5cbcfb7 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb" status: 404 len: 111 microversion: 2.1 time: 0.029773 Oct 28 12:40:06.951447 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 511/1015] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:40:06 2021] GET /compute/v2.1/servers/b81a4bfc-220f-4a70-b4a8-8da612c927fb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:40:07.458067 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-bcdabcc5-1f8a-4452-aad3-ee26bc677c4d tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:40:07.458661 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-bcdabcc5-1f8a-4452-aad3-ee26bc677c4d tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a02b0570-d3b8-4fe1-aa09-199f6525ac0c] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:40:07.465301 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-bcdabcc5-1f8a-4452-aad3-ee26bc677c4d tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:07.465744 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-bcdabcc5-1f8a-4452-aad3-ee26bc677c4d tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:07.466532 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-bcdabcc5-1f8a-4452-aad3-ee26bc677c4d tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:07.466950 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-bcdabcc5-1f8a-4452-aad3-ee26bc677c4d tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:07.481875 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.wsgi [None req-bcdabcc5-1f8a-4452-aad3-ee26bc677c4d tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] HTTP exception thrown: Instance a02b0570-d3b8-4fe1-aa09-199f6525ac0c could not be found. Oct 28 12:40:07.482461 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-bcdabcc5-1f8a-4452-aad3-ee26bc677c4d tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Returning 404 to user: Instance a02b0570-d3b8-4fe1-aa09-199f6525ac0c could not be found. {{(pid=115876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:40:07.483756 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-bcdabcc5-1f8a-4452-aad3-ee26bc677c4d tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c" status: 404 len: 111 microversion: 2.1 time: 0.029321 Oct 28 12:40:07.484361 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 505/1016] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Oct 28 12:40:07 2021] DELETE /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:40:07.492979 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-76f037fc-d67c-487b-92e8-51ab3b27241e tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:40:07.493657 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-76f037fc-d67c-487b-92e8-51ab3b27241e tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] [instance: a02b0570-d3b8-4fe1-aa09-199f6525ac0c] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:40:07.500855 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-76f037fc-d67c-487b-92e8-51ab3b27241e tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:07.501498 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-76f037fc-d67c-487b-92e8-51ab3b27241e tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:07.502511 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-76f037fc-d67c-487b-92e8-51ab3b27241e tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:07.503151 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-76f037fc-d67c-487b-92e8-51ab3b27241e tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:07.517673 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.wsgi [None req-76f037fc-d67c-487b-92e8-51ab3b27241e tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] HTTP exception thrown: Instance a02b0570-d3b8-4fe1-aa09-199f6525ac0c could not be found. Oct 28 12:40:07.517900 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-76f037fc-d67c-487b-92e8-51ab3b27241e tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Returning 404 to user: Instance a02b0570-d3b8-4fe1-aa09-199f6525ac0c could not be found. {{(pid=115877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:40:07.518775 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-76f037fc-d67c-487b-92e8-51ab3b27241e tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c" status: 404 len: 111 microversion: 2.1 time: 0.029860 Oct 28 12:40:07.519326 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 512/1017] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:40:07 2021] GET /compute/v2.1/servers/a02b0570-d3b8-4fe1-aa09-199f6525ac0c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:40:08.838602 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-4830cabb-eb2d-4b25-a225-63d8ac90b813 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] Calling method '.version_select at 0x7f4a79321f70>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:40:08.869467 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-4830cabb-eb2d-4b25-a225-63d8ac90b813 tempest-TestVolumeBootPattern-1161120561 tempest-TestVolumeBootPattern-1161120561-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1357312688" status: 202 len: 0 microversion: 2.1 time: 0.034777 Oct 28 12:40:08.870105 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 506/1018] 10.222.0.62 () {58 vars in 1262 bytes} [Thu Oct 28 12:40:08 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1357312688 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:40:18.111403 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-56324a02-943e-465c-beb8-b1dc2ff33e62 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:40:18.112503 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-56324a02-943e-465c-beb8-b1dc2ff33e62 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:40:18.123064 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-56324a02-943e-465c-beb8-b1dc2ff33e62 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:18.123777 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-56324a02-943e-465c-beb8-b1dc2ff33e62 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:18.125108 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-56324a02-943e-465c-beb8-b1dc2ff33e62 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:18.125807 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-56324a02-943e-465c-beb8-b1dc2ff33e62 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:18.203056 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-56324a02-943e-465c-beb8-b1dc2ff33e62 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "POST /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1/action" status: 202 len: 0 microversion: 2.1 time: 0.097682 Oct 28 12:40:18.203706 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 513/1019] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:40:18 2021] POST /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:40:18.214631 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-813a2edc-36d4-4031-be13-443d8a42afac tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:40:18.215253 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-813a2edc-36d4-4031-be13-443d8a42afac tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:40:18.222383 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-813a2edc-36d4-4031-be13-443d8a42afac tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:18.222814 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-813a2edc-36d4-4031-be13-443d8a42afac tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:18.223576 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-813a2edc-36d4-4031-be13-443d8a42afac tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:18.224038 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-813a2edc-36d4-4031-be13-443d8a42afac tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:18.606004 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-813a2edc-36d4-4031-be13-443d8a42afac tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:40:18.614311 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-813a2edc-36d4-4031-be13-443d8a42afac tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1751 microversion: 2.1 time: 0.404114 Oct 28 12:40:18.614881 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 507/1020] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:40:18 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1751 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:40:19.633303 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-79349fc0-a211-42e0-8a4b-cd64d2372a49 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:40:19.633996 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-79349fc0-a211-42e0-8a4b-cd64d2372a49 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:40:19.641421 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-79349fc0-a211-42e0-8a4b-cd64d2372a49 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:19.641903 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-79349fc0-a211-42e0-8a4b-cd64d2372a49 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:19.642742 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-79349fc0-a211-42e0-8a4b-cd64d2372a49 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:19.643203 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-79349fc0-a211-42e0-8a4b-cd64d2372a49 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:19.783577 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-79349fc0-a211-42e0-8a4b-cd64d2372a49 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:40:19.792568 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-79349fc0-a211-42e0-8a4b-cd64d2372a49 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1756 microversion: 2.1 time: 0.164545 Oct 28 12:40:19.793160 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 514/1021] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:40:19 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:40:20.816508 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-41587660-759d-4c31-9b4c-35e9d50f52b9 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:40:20.818111 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-41587660-759d-4c31-9b4c-35e9d50f52b9 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:40:20.830481 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-41587660-759d-4c31-9b4c-35e9d50f52b9 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:20.831254 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-41587660-759d-4c31-9b4c-35e9d50f52b9 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:20.832029 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-41587660-759d-4c31-9b4c-35e9d50f52b9 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:20.832459 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-41587660-759d-4c31-9b4c-35e9d50f52b9 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:20.974583 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-41587660-759d-4c31-9b4c-35e9d50f52b9 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:40:20.983912 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-41587660-759d-4c31-9b4c-35e9d50f52b9 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1756 microversion: 2.1 time: 0.175898 Oct 28 12:40:20.984494 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 508/1022] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:40:20 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:40:22.004155 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-2ab864d3-7c8a-4d99-83e6-7ed46feaebc5 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:40:22.004765 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-2ab864d3-7c8a-4d99-83e6-7ed46feaebc5 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:40:22.011540 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2ab864d3-7c8a-4d99-83e6-7ed46feaebc5 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:22.011988 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2ab864d3-7c8a-4d99-83e6-7ed46feaebc5 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:22.012745 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2ab864d3-7c8a-4d99-83e6-7ed46feaebc5 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:22.013218 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2ab864d3-7c8a-4d99-83e6-7ed46feaebc5 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:22.140142 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-2ab864d3-7c8a-4d99-83e6-7ed46feaebc5 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:40:22.148312 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-2ab864d3-7c8a-4d99-83e6-7ed46feaebc5 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1756 microversion: 2.1 time: 0.149637 Oct 28 12:40:22.148907 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 515/1023] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:40:21 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1756 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:40:23.166643 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-cd337862-9235-45b6-bb12-1bc9f5c259eb tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:40:23.167503 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-cd337862-9235-45b6-bb12-1bc9f5c259eb tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:40:23.174080 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cd337862-9235-45b6-bb12-1bc9f5c259eb tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:23.174558 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cd337862-9235-45b6-bb12-1bc9f5c259eb tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:23.175327 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cd337862-9235-45b6-bb12-1bc9f5c259eb tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:23.175746 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-cd337862-9235-45b6-bb12-1bc9f5c259eb tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:23.313811 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-cd337862-9235-45b6-bb12-1bc9f5c259eb tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:40:23.321786 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-cd337862-9235-45b6-bb12-1bc9f5c259eb tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1756 microversion: 2.1 time: 0.158984 Oct 28 12:40:23.322352 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 509/1024] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:40:23 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:40:24.342717 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-992594e9-d873-4b10-880f-b3024dbebfab tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:40:24.343698 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-992594e9-d873-4b10-880f-b3024dbebfab tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:40:24.354805 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-992594e9-d873-4b10-880f-b3024dbebfab tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:24.355538 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-992594e9-d873-4b10-880f-b3024dbebfab tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:24.356782 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-992594e9-d873-4b10-880f-b3024dbebfab tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:24.357540 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-992594e9-d873-4b10-880f-b3024dbebfab tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:24.494017 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-992594e9-d873-4b10-880f-b3024dbebfab tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:40:24.502282 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-992594e9-d873-4b10-880f-b3024dbebfab tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1756 microversion: 2.1 time: 0.165717 Oct 28 12:40:24.502979 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 516/1025] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:40:24 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:40:25.522579 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-614a05f4-37a5-4b12-86ae-16fa9d7622ed tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:40:25.523592 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-614a05f4-37a5-4b12-86ae-16fa9d7622ed tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:40:25.533073 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-614a05f4-37a5-4b12-86ae-16fa9d7622ed tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:25.533740 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-614a05f4-37a5-4b12-86ae-16fa9d7622ed tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:25.534646 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-614a05f4-37a5-4b12-86ae-16fa9d7622ed tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:25.535082 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-614a05f4-37a5-4b12-86ae-16fa9d7622ed tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:25.668258 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-614a05f4-37a5-4b12-86ae-16fa9d7622ed tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:40:25.680619 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-614a05f4-37a5-4b12-86ae-16fa9d7622ed tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1756 microversion: 2.1 time: 0.163964 Oct 28 12:40:25.681573 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 510/1026] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:40:25 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:40:26.707030 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-c4639841-cb41-4a7b-8741-3e2b95440cf0 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:40:26.707862 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-c4639841-cb41-4a7b-8741-3e2b95440cf0 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:40:26.714587 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c4639841-cb41-4a7b-8741-3e2b95440cf0 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:26.715025 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c4639841-cb41-4a7b-8741-3e2b95440cf0 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:26.715788 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c4639841-cb41-4a7b-8741-3e2b95440cf0 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:26.716217 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c4639841-cb41-4a7b-8741-3e2b95440cf0 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:26.848220 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-c4639841-cb41-4a7b-8741-3e2b95440cf0 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:40:26.857277 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-c4639841-cb41-4a7b-8741-3e2b95440cf0 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1756 microversion: 2.1 time: 0.156768 Oct 28 12:40:26.857869 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 517/1027] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:40:26 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1756 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:40:27.877803 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-854d918d-718c-4ceb-826e-5e4bf80c7829 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:40:27.878741 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-854d918d-718c-4ceb-826e-5e4bf80c7829 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:40:27.885395 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-854d918d-718c-4ceb-826e-5e4bf80c7829 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:27.885821 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-854d918d-718c-4ceb-826e-5e4bf80c7829 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:27.886574 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-854d918d-718c-4ceb-826e-5e4bf80c7829 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:27.886990 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-854d918d-718c-4ceb-826e-5e4bf80c7829 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:28.041084 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-854d918d-718c-4ceb-826e-5e4bf80c7829 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:40:28.050490 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-854d918d-718c-4ceb-826e-5e4bf80c7829 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1756 microversion: 2.1 time: 0.176642 Oct 28 12:40:28.051704 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 511/1028] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:40:27 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:40:29.069805 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-557a5788-0d2d-4574-8d3e-6064a2d24eb7 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:40:29.070447 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-557a5788-0d2d-4574-8d3e-6064a2d24eb7 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:40:29.077145 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-557a5788-0d2d-4574-8d3e-6064a2d24eb7 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:29.077589 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-557a5788-0d2d-4574-8d3e-6064a2d24eb7 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:29.078351 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-557a5788-0d2d-4574-8d3e-6064a2d24eb7 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:29.078778 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-557a5788-0d2d-4574-8d3e-6064a2d24eb7 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:29.211887 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-557a5788-0d2d-4574-8d3e-6064a2d24eb7 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:40:29.220257 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-557a5788-0d2d-4574-8d3e-6064a2d24eb7 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1756 microversion: 2.1 time: 0.154436 Oct 28 12:40:29.220851 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 518/1029] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:40:29 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1756 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:40:30.243023 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-2530ebe6-df85-4453-86d4-4600c0f671cd tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:40:30.243997 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-2530ebe6-df85-4453-86d4-4600c0f671cd tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:40:30.254095 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2530ebe6-df85-4453-86d4-4600c0f671cd tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:30.254533 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2530ebe6-df85-4453-86d4-4600c0f671cd tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:30.255376 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2530ebe6-df85-4453-86d4-4600c0f671cd tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:40:30.255805 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2530ebe6-df85-4453-86d4-4600c0f671cd tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:40:30.399217 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-2530ebe6-df85-4453-86d4-4600c0f671cd tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:40:30.407532 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-2530ebe6-df85-4453-86d4-4600c0f671cd tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1759 microversion: 2.1 time: 0.170706 Oct 28 12:40:30.408113 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 512/1030] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:40:30 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1759 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:40:55.315787 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 12:40:55.316379 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: Thu Oct 28 12:40:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 12:41:02.739303 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-18955f34-531b-498c-a9f8-1058ecbfcf1d tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1512310625"}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:41:02.740025 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-18955f34-531b-498c-a9f8-1058ecbfcf1d tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:41:02.746283 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-18955f34-531b-498c-a9f8-1058ecbfcf1d tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:02.746728 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-18955f34-531b-498c-a9f8-1058ecbfcf1d tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:02.747480 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-18955f34-531b-498c-a9f8-1058ecbfcf1d tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:02.747904 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-18955f34-531b-498c-a9f8-1058ecbfcf1d tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:02.995902 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.network.security_group_api [None req-18955f34-531b-498c-a9f8-1058ecbfcf1d tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Removing security group ba8386f8-3feb-4b39-8b70-06f88e039ea1 from port 29368d97-129c-41f1-b476-6e9c1655e8e5 Oct 28 12:41:03.342344 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-18955f34-531b-498c-a9f8-1058ecbfcf1d tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "POST /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1/action" status: 202 len: 0 microversion: 2.1 time: 0.607040 Oct 28 12:41:03.359056 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 519/1031] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:41:02 2021] POST /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1/action => generated 0 bytes in 624 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:41:03.454636 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-89736e96-4ee8-4843-a3cd-2fccb706665d req-2075a14f-145c-48cf-b31e-9ef19cba8de0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1", "tag": "29368d97-129c-41f1-b476-6e9c1655e8e5"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:41:03.456638 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:41:03.456638 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:41:03.464157 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-89736e96-4ee8-4843-a3cd-2fccb706665d req-2075a14f-145c-48cf-b31e-9ef19cba8de0 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:03.465985 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-89736e96-4ee8-4843-a3cd-2fccb706665d req-2075a14f-145c-48cf-b31e-9ef19cba8de0 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:03.486946 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-89736e96-4ee8-4843-a3cd-2fccb706665d req-2075a14f-145c-48cf-b31e-9ef19cba8de0 service nova] Creating event network-changed:29368d97-129c-41f1-b476-6e9c1655e8e5 for instance ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 on hv-cinder-81514 Oct 28 12:41:03.494104 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-89736e96-4ee8-4843-a3cd-2fccb706665d req-2075a14f-145c-48cf-b31e-9ef19cba8de0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138995 Oct 28 12:41:03.495364 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 513/1032] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:41:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:41:04.507988 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-835cafc0-f750-41fe-bcd9-891ba1eed9c4 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:41:04.508566 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-835cafc0-f750-41fe-bcd9-891ba1eed9c4 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:41:04.514730 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-835cafc0-f750-41fe-bcd9-891ba1eed9c4 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:04.515176 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-835cafc0-f750-41fe-bcd9-891ba1eed9c4 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:04.515957 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-835cafc0-f750-41fe-bcd9-891ba1eed9c4 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:04.516404 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-835cafc0-f750-41fe-bcd9-891ba1eed9c4 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:04.603415 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.objects.instance [None req-835cafc0-f750-41fe-bcd9-891ba1eed9c4 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lazy-loading 'services' on Instance uuid ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 {{(pid=115877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:41:04.679998 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-835cafc0-f750-41fe-bcd9-891ba1eed9c4 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1/os-volume_attachments/81b21938-73ac-4c20-9a2f-c086f86f33ae" status: 202 len: 0 microversion: 2.1 time: 0.176198 Oct 28 12:41:04.680621 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 520/1033] 10.222.0.62 () {58 vars in 1415 bytes} [Thu Oct 28 12:41:04 2021] DELETE /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1/os-volume_attachments/81b21938-73ac-4c20-9a2f-c086f86f33ae => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:41:04.690301 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-348591c0-a4a2-4e25-b914-525a91d5325b tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:41:04.691911 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-348591c0-a4a2-4e25-b914-525a91d5325b tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:41:04.698492 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-348591c0-a4a2-4e25-b914-525a91d5325b tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:04.699160 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-348591c0-a4a2-4e25-b914-525a91d5325b tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:04.700175 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-348591c0-a4a2-4e25-b914-525a91d5325b tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:04.700585 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-348591c0-a4a2-4e25-b914-525a91d5325b tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:04.733543 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-348591c0-a4a2-4e25-b914-525a91d5325b tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048011 Oct 28 12:41:04.733980 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 514/1034] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Oct 28 12:41:04 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:41:05.512902 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-43456327-3fa6-4014-928d-2a5733e6f65e req-bbbd17c9-3c19-4efa-801e-a77b98347890 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1", "tag": "29368d97-129c-41f1-b476-6e9c1655e8e5"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:41:05.514523 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:41:05.514523 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:41:05.523741 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-43456327-3fa6-4014-928d-2a5733e6f65e req-bbbd17c9-3c19-4efa-801e-a77b98347890 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:05.524176 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-43456327-3fa6-4014-928d-2a5733e6f65e req-bbbd17c9-3c19-4efa-801e-a77b98347890 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:05.536892 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-43456327-3fa6-4014-928d-2a5733e6f65e req-bbbd17c9-3c19-4efa-801e-a77b98347890 service nova] Creating event network-changed:29368d97-129c-41f1-b476-6e9c1655e8e5 for instance ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 on hv-cinder-81514 Oct 28 12:41:05.544792 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-43456327-3fa6-4014-928d-2a5733e6f65e req-bbbd17c9-3c19-4efa-801e-a77b98347890 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036693 Oct 28 12:41:05.545762 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 521/1035] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:41:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:41:05.748482 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-755b9e85-55e4-4b5d-bbee-ae5bd1295883 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:41:05.749603 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-755b9e85-55e4-4b5d-bbee-ae5bd1295883 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:41:05.756874 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-755b9e85-55e4-4b5d-bbee-ae5bd1295883 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:05.757319 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-755b9e85-55e4-4b5d-bbee-ae5bd1295883 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:05.758081 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-755b9e85-55e4-4b5d-bbee-ae5bd1295883 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:05.758508 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-755b9e85-55e4-4b5d-bbee-ae5bd1295883 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:05.787589 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-755b9e85-55e4-4b5d-bbee-ae5bd1295883 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044928 Oct 28 12:41:05.788185 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 515/1036] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Oct 28 12:41:05 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:41:05.799885 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-3896def8-ccf6-47b7-a5da-0c4ab7a22fd9 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:41:05.800529 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-3896def8-ccf6-47b7-a5da-0c4ab7a22fd9 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:41:05.806688 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3896def8-ccf6-47b7-a5da-0c4ab7a22fd9 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:05.807204 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3896def8-ccf6-47b7-a5da-0c4ab7a22fd9 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:05.808063 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3896def8-ccf6-47b7-a5da-0c4ab7a22fd9 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:05.808565 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-3896def8-ccf6-47b7-a5da-0c4ab7a22fd9 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:05.881598 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.wsgi [None req-3896def8-ccf6-47b7-a5da-0c4ab7a22fd9 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] HTTP exception thrown: Instance ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 is not attached to volume 81b21938-73ac-4c20-9a2f-c086f86f33ae Oct 28 12:41:05.882192 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-3896def8-ccf6-47b7-a5da-0c4ab7a22fd9 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Returning 404 to user: Instance ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 is not attached to volume 81b21938-73ac-4c20-9a2f-c086f86f33ae {{(pid=115877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:41:05.883030 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-3896def8-ccf6-47b7-a5da-0c4ab7a22fd9 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1/os-volume_attachments/81b21938-73ac-4c20-9a2f-c086f86f33ae" status: 404 len: 154 microversion: 2.1 time: 0.087788 Oct 28 12:41:05.883581 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 522/1037] 10.222.0.62 () {58 vars in 1415 bytes} [Thu Oct 28 12:41:05 2021] DELETE /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1/os-volume_attachments/81b21938-73ac-4c20-9a2f-c086f86f33ae => generated 154 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 12:41:07.018428 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-56f853f6-95e6-4313-b758-a6bceea19665 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:41:07.019140 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-56f853f6-95e6-4313-b758-a6bceea19665 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:41:07.027941 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-56f853f6-95e6-4313-b758-a6bceea19665 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:07.028558 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-56f853f6-95e6-4313-b758-a6bceea19665 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:07.029408 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-56f853f6-95e6-4313-b758-a6bceea19665 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:07.029826 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-56f853f6-95e6-4313-b758-a6bceea19665 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:07.064549 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-56f853f6-95e6-4313-b758-a6bceea19665 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Going to try to terminate instance {{(pid=115876) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:41:07.164029 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-56f853f6-95e6-4313-b758-a6bceea19665 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 204 len: 0 microversion: 2.1 time: 0.150006 Oct 28 12:41:07.165001 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 516/1038] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Oct 28 12:41:07 2021] DELETE /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:41:07.175501 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-944c9b47-1bb3-475a-b435-c2740b42964c tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:41:07.176105 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-944c9b47-1bb3-475a-b435-c2740b42964c tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:41:07.189674 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-944c9b47-1bb3-475a-b435-c2740b42964c tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:07.190157 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-944c9b47-1bb3-475a-b435-c2740b42964c tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:07.191029 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-944c9b47-1bb3-475a-b435-c2740b42964c tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:07.191385 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-944c9b47-1bb3-475a-b435-c2740b42964c tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:07.336688 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-944c9b47-1bb3-475a-b435-c2740b42964c tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:41:07.347498 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-944c9b47-1bb3-475a-b435-c2740b42964c tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1553 microversion: 2.1 time: 0.176341 Oct 28 12:41:07.348144 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 523/1039] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:41:07 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1553 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:41:08.366229 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-f4e5d382-9663-4a76-959d-386a2f694aea tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:41:08.366953 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-f4e5d382-9663-4a76-959d-386a2f694aea tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:41:08.373681 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f4e5d382-9663-4a76-959d-386a2f694aea tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:08.374110 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f4e5d382-9663-4a76-959d-386a2f694aea tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:08.374875 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f4e5d382-9663-4a76-959d-386a2f694aea tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:08.375300 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f4e5d382-9663-4a76-959d-386a2f694aea tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:08.558543 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f4e5d382-9663-4a76-959d-386a2f694aea tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:41:08.566763 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-f4e5d382-9663-4a76-959d-386a2f694aea tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1553 microversion: 2.1 time: 0.204970 Oct 28 12:41:08.567346 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 517/1040] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:41:08 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1553 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:41:09.337023 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-d988e458-06f9-4d25-b8c4-6291dd5c8549 req-4a714918-f35c-4b25-aefa-4d34538196fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1", "name": "network-vif-deleted", "tag": "29368d97-129c-41f1-b476-6e9c1655e8e5"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:41:09.338620 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:41:09.338620 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:41:09.346545 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-d988e458-06f9-4d25-b8c4-6291dd5c8549 req-4a714918-f35c-4b25-aefa-4d34538196fd service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:09.347057 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-d988e458-06f9-4d25-b8c4-6291dd5c8549 req-4a714918-f35c-4b25-aefa-4d34538196fd service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:09.358505 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-d988e458-06f9-4d25-b8c4-6291dd5c8549 req-4a714918-f35c-4b25-aefa-4d34538196fd service nova] Creating event network-vif-deleted:29368d97-129c-41f1-b476-6e9c1655e8e5 for instance ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 on hv-cinder-81514 Oct 28 12:41:09.363488 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-d988e458-06f9-4d25-b8c4-6291dd5c8549 req-4a714918-f35c-4b25-aefa-4d34538196fd service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030115 Oct 28 12:41:09.364124 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 524/1041] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:41:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:41:09.584828 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-a3883c80-c43f-4dd7-9431-922a7b11c1a6 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:41:09.585436 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-a3883c80-c43f-4dd7-9431-922a7b11c1a6 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:41:09.592018 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a3883c80-c43f-4dd7-9431-922a7b11c1a6 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:09.592453 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a3883c80-c43f-4dd7-9431-922a7b11c1a6 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:09.593249 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a3883c80-c43f-4dd7-9431-922a7b11c1a6 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:09.593693 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a3883c80-c43f-4dd7-9431-922a7b11c1a6 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:09.626795 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a3883c80-c43f-4dd7-9431-922a7b11c1a6 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:09.627217 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a3883c80-c43f-4dd7-9431-922a7b11c1a6 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:09.627655 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.objects.instance [None req-a3883c80-c43f-4dd7-9431-922a7b11c1a6 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lazy-loading 'fault' on Instance uuid ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 {{(pid=115876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:41:09.676579 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-a3883c80-c43f-4dd7-9431-922a7b11c1a6 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfa94737a344d44b39d62747687df61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c86daf60914cc3b120db57c84e7a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:41:09.687364 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-a3883c80-c43f-4dd7-9431-922a7b11c1a6 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 200 len: 1348 microversion: 2.1 time: 0.106582 Oct 28 12:41:09.687948 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 518/1042] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:41:09 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 1348 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:41:10.706062 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-b7c5d818-7548-4aa6-9633-745f116b5228 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:41:10.706748 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-b7c5d818-7548-4aa6-9633-745f116b5228 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] [instance: ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:41:10.713578 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b7c5d818-7548-4aa6-9633-745f116b5228 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:10.714025 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b7c5d818-7548-4aa6-9633-745f116b5228 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:10.714792 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b7c5d818-7548-4aa6-9633-745f116b5228 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:10.715230 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b7c5d818-7548-4aa6-9633-745f116b5228 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:10.729947 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.wsgi [None req-b7c5d818-7548-4aa6-9633-745f116b5228 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] HTTP exception thrown: Instance ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 could not be found. Oct 28 12:41:10.730541 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-b7c5d818-7548-4aa6-9633-745f116b5228 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Returning 404 to user: Instance ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 could not be found. {{(pid=115877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:41:10.731376 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-b7c5d818-7548-4aa6-9633-745f116b5228 tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1" status: 404 len: 111 microversion: 2.1 time: 0.030030 Oct 28 12:41:10.731926 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 525/1043] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:41:10 2021] GET /compute/v2.1/servers/ffe65c4d-d911-47d5-9c3c-4ba93b3bf8a1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:41:10.740742 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-15e63933-789f-4e40-92da-364695957d5a tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] Calling method '.version_select at 0x7f4a79416ca0>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:41:10.765939 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-15e63933-789f-4e40-92da-364695957d5a tempest-TestMinimumBasicScenario-81389248 tempest-TestMinimumBasicScenario-81389248-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-872802021" status: 202 len: 0 microversion: 2.1 time: 0.028939 Oct 28 12:41:10.766642 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 519/1044] 10.222.0.62 () {58 vars in 1268 bytes} [Thu Oct 28 12:41:10 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-872802021 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:41:29.131884 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-db148336-f93d-4826-a906-c8ed5bc75298 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Action: 'create', calling method: .version_select at 0x7f4a794078b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1478594294"}} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:41:29.153031 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.quota [None req-db148336-f93d-4826-a906-c8ed5bc75298 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Getting quotas for project d60093ead9d64a9894ae4caafeaf039b. Resources: {'key_pairs'} {{(pid=115877) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:41:29.154462 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.quota [None req-db148336-f93d-4826-a906-c8ed5bc75298 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Getting quotas for user 5b8e5f1cbf384f1895492671dd613299 and project d60093ead9d64a9894ae4caafeaf039b. Resources: {'key_pairs'} {{(pid=115877) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:41:29.330229 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.quota [None req-db148336-f93d-4826-a906-c8ed5bc75298 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Getting quotas for project d60093ead9d64a9894ae4caafeaf039b. Resources: {'key_pairs'} {{(pid=115877) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:41:29.334017 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.quota [None req-db148336-f93d-4826-a906-c8ed5bc75298 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Getting quotas for user 5b8e5f1cbf384f1895492671dd613299 and project d60093ead9d64a9894ae4caafeaf039b. Resources: {'key_pairs'} {{(pid=115877) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:41:29.348382 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-db148336-f93d-4826-a906-c8ed5bc75298 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.393081 Oct 28 12:41:29.349101 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 526/1045] 10.222.0.62 () {60 vars in 1157 bytes} [Thu Oct 28 12:41:28 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:41:46.872086 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-a4694ac5-6d3f-437c-923b-ae740e9809fe tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1189815808", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1478594294", "security_groups": [{"name": "tempest-secgroup-smoke-867481144"}], "networks": [{"uuid": "71fa641d-7c6f-4c7c-a1ae-f1fa2749eb85"}], "block_device_mapping_v2": [{"uuid": "8e17c664-fd48-4ea7-b8e7-96607109b0d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:41:46.975769 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.network.neutron [None req-a4694ac5-6d3f-437c-923b-ae740e9809fe tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] validate_networks() for [('71fa641d-7c6f-4c7c-a1ae-f1fa2749eb85', None, None, None, None, None)] {{(pid=115876) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:41:47.478412 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-a4694ac5-6d3f-437c-923b-ae740e9809fe tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Flavor limits 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:41:47.478819 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-a4694ac5-6d3f-437c-923b-ae740e9809fe tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Image limits 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:41:47.479273 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-a4694ac5-6d3f-437c-923b-ae740e9809fe tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Flavor pref 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:41:47.479664 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-a4694ac5-6d3f-437c-923b-ae740e9809fe tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Image pref 0:0:0 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:41:47.480056 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.virt.hardware [None req-a4694ac5-6d3f-437c-923b-ae740e9809fe tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:41:47.489176 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a4694ac5-6d3f-437c-923b-ae740e9809fe tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:47.489603 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a4694ac5-6d3f-437c-923b-ae740e9809fe tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:47.490384 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a4694ac5-6d3f-437c-923b-ae740e9809fe tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:47.490806 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-a4694ac5-6d3f-437c-923b-ae740e9809fe tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:47.507753 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-a4694ac5-6d3f-437c-923b-ae740e9809fe tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Getting quotas for project d60093ead9d64a9894ae4caafeaf039b. Resources: {'cores', 'instances', 'ram'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:41:47.512276 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.quota [None req-a4694ac5-6d3f-437c-923b-ae740e9809fe tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Getting quotas for user 5b8e5f1cbf384f1895492671dd613299 and project d60093ead9d64a9894ae4caafeaf039b. Resources: {'cores', 'instances', 'ram'} {{(pid=115876) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:41:47.574057 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-a4694ac5-6d3f-437c-923b-ae740e9809fe tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Going to run 1 instances... {{(pid=115876) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:41:47.576222 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-a4694ac5-6d3f-437c-923b-ae740e9809fe tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8e17c664-fd48-4ea7-b8e7-96607109b0d8',volume_size=None,volume_type=None)] {{(pid=115876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:41:47.700890 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a4694ac5-6d3f-437c-923b-ae740e9809fe tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [183584f8-1649-448f-b817-a3e7b7d64bbe] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 12:41:48.721345 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO oslo.messaging._drivers.impl_rabbit [None req-a4694ac5-6d3f-437c-923b-ae740e9809fe tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [183584f8-1649-448f-b817-a3e7b7d64bbe] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 56070. Oct 28 12:41:48.726320 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-a4694ac5-6d3f-437c-923b-ae740e9809fe tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.858675 Oct 28 12:41:48.726970 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 520/1046] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Oct 28 12:41:46 2021] POST /compute/v2.1/servers => generated 405 bytes in 1860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 12:41:48.739128 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-47cf33f4-79e0-4bd9-bbb3-397fd008fab9 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:41:48.739722 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-47cf33f4-79e0-4bd9-bbb3-397fd008fab9 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:41:48.793474 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-47cf33f4-79e0-4bd9-bbb3-397fd008fab9 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:41:48.800525 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-47cf33f4-79e0-4bd9-bbb3-397fd008fab9 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1089 microversion: 2.1 time: 0.065687 Oct 28 12:41:48.801463 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 527/1047] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:41:48 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1089 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:41:49.818124 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-07cb2b9a-abb5-4b88-9bab-ac26524b30ce tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:41:49.819573 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-07cb2b9a-abb5-4b88-9bab-ac26524b30ce tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:41:49.827209 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-07cb2b9a-abb5-4b88-9bab-ac26524b30ce tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:49.827695 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-07cb2b9a-abb5-4b88-9bab-ac26524b30ce tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:49.828464 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-07cb2b9a-abb5-4b88-9bab-ac26524b30ce tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:49.828918 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-07cb2b9a-abb5-4b88-9bab-ac26524b30ce tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:49.898310 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-07cb2b9a-abb5-4b88-9bab-ac26524b30ce tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:41:49.906082 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-07cb2b9a-abb5-4b88-9bab-ac26524b30ce tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1195 microversion: 2.1 time: 0.092065 Oct 28 12:41:49.906865 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 521/1048] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:41:49 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1195 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:41:50.923918 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-c42d6ecf-218d-4c13-b5c5-7a0325ef14e7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:41:50.924510 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-c42d6ecf-218d-4c13-b5c5-7a0325ef14e7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:41:50.931149 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c42d6ecf-218d-4c13-b5c5-7a0325ef14e7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:50.931592 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c42d6ecf-218d-4c13-b5c5-7a0325ef14e7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:50.932361 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c42d6ecf-218d-4c13-b5c5-7a0325ef14e7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:50.932854 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-c42d6ecf-218d-4c13-b5c5-7a0325ef14e7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:51.063399 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-c42d6ecf-218d-4c13-b5c5-7a0325ef14e7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:41:51.071021 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-c42d6ecf-218d-4c13-b5c5-7a0325ef14e7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1260 microversion: 2.1 time: 0.151111 Oct 28 12:41:51.071849 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 528/1049] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:41:50 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:41:51.171407 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-0b79636d-2f28-4eb4-97fc-f4adab11f363 req-ad124b53-6007-4ed3-861d-eb91c6eb99ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "552d8774-7d69-4ef5-b4e9-b0641e193beb", "tag": "988ed513-b45c-4553-99bb-415e6179c274"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:41:51.175858 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:41:51.175858 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:41:51.183533 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-0b79636d-2f28-4eb4-97fc-f4adab11f363 req-ad124b53-6007-4ed3-861d-eb91c6eb99ca service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:51.184218 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-0b79636d-2f28-4eb4-97fc-f4adab11f363 req-ad124b53-6007-4ed3-861d-eb91c6eb99ca service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:51.201244 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-0b79636d-2f28-4eb4-97fc-f4adab11f363 req-ad124b53-6007-4ed3-861d-eb91c6eb99ca service nova] Creating event network-changed:988ed513-b45c-4553-99bb-415e6179c274 for instance 552d8774-7d69-4ef5-b4e9-b0641e193beb on hv-cinder-81514 Oct 28 12:41:51.206998 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-0b79636d-2f28-4eb4-97fc-f4adab11f363 req-ad124b53-6007-4ed3-861d-eb91c6eb99ca service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039183 Oct 28 12:41:51.207574 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 522/1050] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:41:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:41:52.088260 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-2fd743c7-6c19-4ebb-b821-dcd76b0ba657 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:41:52.088862 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-2fd743c7-6c19-4ebb-b821-dcd76b0ba657 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:41:52.095535 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2fd743c7-6c19-4ebb-b821-dcd76b0ba657 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:52.096074 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2fd743c7-6c19-4ebb-b821-dcd76b0ba657 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:52.097111 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2fd743c7-6c19-4ebb-b821-dcd76b0ba657 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:52.097535 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-2fd743c7-6c19-4ebb-b821-dcd76b0ba657 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:52.226728 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-2fd743c7-6c19-4ebb-b821-dcd76b0ba657 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:41:52.234452 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-2fd743c7-6c19-4ebb-b821-dcd76b0ba657 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1260 microversion: 2.1 time: 0.149980 Oct 28 12:41:52.235022 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 529/1051] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:41:52 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:41:53.256138 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-729528e2-c6e6-4f4e-93b2-5e09554afa50 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:41:53.257239 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-729528e2-c6e6-4f4e-93b2-5e09554afa50 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:41:53.267092 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-729528e2-c6e6-4f4e-93b2-5e09554afa50 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:53.267734 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-729528e2-c6e6-4f4e-93b2-5e09554afa50 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:53.268967 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-729528e2-c6e6-4f4e-93b2-5e09554afa50 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:53.269616 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-729528e2-c6e6-4f4e-93b2-5e09554afa50 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:53.404538 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-729528e2-c6e6-4f4e-93b2-5e09554afa50 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:41:53.415161 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-729528e2-c6e6-4f4e-93b2-5e09554afa50 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1260 microversion: 2.1 time: 0.165946 Oct 28 12:41:53.415749 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 523/1052] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:41:53 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:41:54.441526 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-0905a82c-7a77-4cf5-9f57-5562342b642a tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:41:54.442475 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-0905a82c-7a77-4cf5-9f57-5562342b642a tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:41:54.449980 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0905a82c-7a77-4cf5-9f57-5562342b642a tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:54.450419 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0905a82c-7a77-4cf5-9f57-5562342b642a tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:54.451175 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0905a82c-7a77-4cf5-9f57-5562342b642a tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:54.451601 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0905a82c-7a77-4cf5-9f57-5562342b642a tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:54.603341 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-0905a82c-7a77-4cf5-9f57-5562342b642a tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:41:54.611568 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-0905a82c-7a77-4cf5-9f57-5562342b642a tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1260 microversion: 2.1 time: 0.176857 Oct 28 12:41:54.612151 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 530/1053] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:41:54 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:41:55.636057 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-f874f32c-24b6-45ad-a575-8d9e4595003b tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:41:55.637136 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-f874f32c-24b6-45ad-a575-8d9e4595003b tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:41:55.647892 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f874f32c-24b6-45ad-a575-8d9e4595003b tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:55.648337 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f874f32c-24b6-45ad-a575-8d9e4595003b tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:55.649145 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f874f32c-24b6-45ad-a575-8d9e4595003b tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:55.649572 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-f874f32c-24b6-45ad-a575-8d9e4595003b tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:55.786793 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-f874f32c-24b6-45ad-a575-8d9e4595003b tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:41:55.794718 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-f874f32c-24b6-45ad-a575-8d9e4595003b tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1260 microversion: 2.1 time: 0.164787 Oct 28 12:41:55.795279 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 524/1054] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:41:55 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:41:56.811789 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-ab303211-cc3e-46ae-ba88-75bddf45439f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:41:56.812424 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-ab303211-cc3e-46ae-ba88-75bddf45439f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:41:56.819245 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ab303211-cc3e-46ae-ba88-75bddf45439f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:56.819699 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ab303211-cc3e-46ae-ba88-75bddf45439f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:56.820471 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ab303211-cc3e-46ae-ba88-75bddf45439f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:56.820974 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-ab303211-cc3e-46ae-ba88-75bddf45439f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:56.957239 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-ab303211-cc3e-46ae-ba88-75bddf45439f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:41:56.966367 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-ab303211-cc3e-46ae-ba88-75bddf45439f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1260 microversion: 2.1 time: 0.158328 Oct 28 12:41:56.966936 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 531/1055] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:41:56 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:41:57.984250 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-bb7384c3-46a8-4199-9725-8fb047dbfd9d tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:41:57.984842 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-bb7384c3-46a8-4199-9725-8fb047dbfd9d tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:41:57.991839 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-bb7384c3-46a8-4199-9725-8fb047dbfd9d tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:57.992290 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-bb7384c3-46a8-4199-9725-8fb047dbfd9d tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:57.993127 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-bb7384c3-46a8-4199-9725-8fb047dbfd9d tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:57.993554 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-bb7384c3-46a8-4199-9725-8fb047dbfd9d tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:58.125831 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-bb7384c3-46a8-4199-9725-8fb047dbfd9d tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:41:58.135729 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-bb7384c3-46a8-4199-9725-8fb047dbfd9d tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1260 microversion: 2.1 time: 0.155228 Oct 28 12:41:58.136262 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 525/1056] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:41:57 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:41:59.154209 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-375cc1cb-70c1-4294-907f-b34151d9c307 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:41:59.154830 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-375cc1cb-70c1-4294-907f-b34151d9c307 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:41:59.161665 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-375cc1cb-70c1-4294-907f-b34151d9c307 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:59.162114 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-375cc1cb-70c1-4294-907f-b34151d9c307 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:59.162884 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-375cc1cb-70c1-4294-907f-b34151d9c307 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:41:59.163316 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-375cc1cb-70c1-4294-907f-b34151d9c307 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:41:59.295189 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-375cc1cb-70c1-4294-907f-b34151d9c307 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:41:59.304371 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-375cc1cb-70c1-4294-907f-b34151d9c307 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1260 microversion: 2.1 time: 0.154006 Oct 28 12:41:59.305304 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 532/1057] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:41:59 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:42:00.323367 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-338ebd32-76ef-4eb9-851c-e0b621febd79 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:42:00.323971 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-338ebd32-76ef-4eb9-851c-e0b621febd79 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:42:00.331484 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-338ebd32-76ef-4eb9-851c-e0b621febd79 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:42:00.331969 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-338ebd32-76ef-4eb9-851c-e0b621febd79 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:42:00.332818 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-338ebd32-76ef-4eb9-851c-e0b621febd79 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:42:00.333311 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-338ebd32-76ef-4eb9-851c-e0b621febd79 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:42:00.465899 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-338ebd32-76ef-4eb9-851c-e0b621febd79 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:42:00.473204 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-338ebd32-76ef-4eb9-851c-e0b621febd79 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1260 microversion: 2.1 time: 0.154725 Oct 28 12:42:00.473771 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 526/1058] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:42:00 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:42:01.490240 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-fb41d211-06e6-4a78-a75a-efe23acff5e8 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:42:01.490873 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-fb41d211-06e6-4a78-a75a-efe23acff5e8 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:42:01.497260 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fb41d211-06e6-4a78-a75a-efe23acff5e8 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:42:01.497704 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fb41d211-06e6-4a78-a75a-efe23acff5e8 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:42:01.498453 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fb41d211-06e6-4a78-a75a-efe23acff5e8 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:42:01.498913 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-fb41d211-06e6-4a78-a75a-efe23acff5e8 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:42:01.571379 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [req-477efce8-db12-45af-9599-11d42c979cc6 req-cb87a9a3-0f89-46c3-b9e7-9a7a31471cae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "552d8774-7d69-4ef5-b4e9-b0641e193beb", "name": "network-vif-plugged", "status": "completed", "tag": "988ed513-b45c-4553-99bb-415e6179c274"}]} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:42:01.572949 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:42:01.572949 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: warnings.warn(msg) Oct 28 12:42:01.580379 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-477efce8-db12-45af-9599-11d42c979cc6 req-cb87a9a3-0f89-46c3-b9e7-9a7a31471cae service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:42:01.580833 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [req-477efce8-db12-45af-9599-11d42c979cc6 req-cb87a9a3-0f89-46c3-b9e7-9a7a31471cae service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:42:01.593048 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.compute.server_external_events [req-477efce8-db12-45af-9599-11d42c979cc6 req-cb87a9a3-0f89-46c3-b9e7-9a7a31471cae service nova] Creating event network-vif-plugged:988ed513-b45c-4553-99bb-415e6179c274 for instance 552d8774-7d69-4ef5-b4e9-b0641e193beb on hv-cinder-81514 Oct 28 12:42:01.598276 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [req-477efce8-db12-45af-9599-11d42c979cc6 req-cb87a9a3-0f89-46c3-b9e7-9a7a31471cae service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103550 Oct 28 12:42:01.598870 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 527/1059] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:42:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:42:01.627814 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-fb41d211-06e6-4a78-a75a-efe23acff5e8 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:42:01.637590 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-fb41d211-06e6-4a78-a75a-efe23acff5e8 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1260 microversion: 2.1 time: 0.151109 Oct 28 12:42:01.638160 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 533/1060] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:42:01 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:42:02.659082 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-444e6995-e637-485b-8b03-5bc4f4b559a7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:42:02.660212 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-444e6995-e637-485b-8b03-5bc4f4b559a7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:42:02.669104 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-444e6995-e637-485b-8b03-5bc4f4b559a7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:42:02.669529 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-444e6995-e637-485b-8b03-5bc4f4b559a7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:42:02.670291 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-444e6995-e637-485b-8b03-5bc4f4b559a7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:42:02.670724 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-444e6995-e637-485b-8b03-5bc4f4b559a7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:42:02.803614 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-444e6995-e637-485b-8b03-5bc4f4b559a7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:42:02.811127 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-444e6995-e637-485b-8b03-5bc4f4b559a7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1260 microversion: 2.1 time: 0.159609 Oct 28 12:42:02.811774 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 528/1061] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:42:02 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:42:03.829500 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-d984aa56-e721-4ab6-bf1f-b86cdccc9e47 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:42:03.830230 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-d984aa56-e721-4ab6-bf1f-b86cdccc9e47 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:42:03.838514 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d984aa56-e721-4ab6-bf1f-b86cdccc9e47 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:42:03.838957 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d984aa56-e721-4ab6-bf1f-b86cdccc9e47 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:42:03.839717 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d984aa56-e721-4ab6-bf1f-b86cdccc9e47 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:42:03.840138 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d984aa56-e721-4ab6-bf1f-b86cdccc9e47 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:42:03.968300 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-d984aa56-e721-4ab6-bf1f-b86cdccc9e47 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:42:03.976380 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-d984aa56-e721-4ab6-bf1f-b86cdccc9e47 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1444 microversion: 2.1 time: 0.151585 Oct 28 12:42:03.976991 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 534/1062] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:42:03 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1444 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:42:03.992609 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-e71203c3-5c37-427a-9a49-898c6949b56e tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:42:03.993275 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-e71203c3-5c37-427a-9a49-898c6949b56e tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:42:04.001648 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e71203c3-5c37-427a-9a49-898c6949b56e tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:42:04.002096 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e71203c3-5c37-427a-9a49-898c6949b56e tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:42:04.002863 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e71203c3-5c37-427a-9a49-898c6949b56e tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:42:04.003291 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-e71203c3-5c37-427a-9a49-898c6949b56e tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:42:04.137816 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-e71203c3-5c37-427a-9a49-898c6949b56e tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:42:04.148238 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-e71203c3-5c37-427a-9a49-898c6949b56e tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1444 microversion: 2.1 time: 0.159109 Oct 28 12:42:04.149212 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 529/1063] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:42:03 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1444 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:42:05.871204 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-3e7f7c70-2771-48b5-ab9d-575ab99c8d15 req-7fed2cc1-c50c-4ef1-a1aa-b1da18eb570c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "552d8774-7d69-4ef5-b4e9-b0641e193beb", "tag": "988ed513-b45c-4553-99bb-415e6179c274"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:42:05.873139 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:42:05.873139 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:42:05.881293 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-3e7f7c70-2771-48b5-ab9d-575ab99c8d15 req-7fed2cc1-c50c-4ef1-a1aa-b1da18eb570c service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:42:05.881854 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-3e7f7c70-2771-48b5-ab9d-575ab99c8d15 req-7fed2cc1-c50c-4ef1-a1aa-b1da18eb570c service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:42:05.892585 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-3e7f7c70-2771-48b5-ab9d-575ab99c8d15 req-7fed2cc1-c50c-4ef1-a1aa-b1da18eb570c service nova] Creating event network-changed:988ed513-b45c-4553-99bb-415e6179c274 for instance 552d8774-7d69-4ef5-b4e9-b0641e193beb on hv-cinder-81514 Oct 28 12:42:05.897767 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-3e7f7c70-2771-48b5-ab9d-575ab99c8d15 req-7fed2cc1-c50c-4ef1-a1aa-b1da18eb570c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030574 Oct 28 12:42:05.898332 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 535/1064] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:42:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:44:00.414200 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-7329e533-9188-4f6e-9427-d8381e6650ab tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:44:00.414791 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-7329e533-9188-4f6e-9427-d8381e6650ab tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:44:00.421691 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7329e533-9188-4f6e-9427-d8381e6650ab tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:00.422138 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7329e533-9188-4f6e-9427-d8381e6650ab tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:00.422916 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7329e533-9188-4f6e-9427-d8381e6650ab tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:00.423344 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-7329e533-9188-4f6e-9427-d8381e6650ab tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:00.447691 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.objects.instance [None req-7329e533-9188-4f6e-9427-d8381e6650ab tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lazy-loading 'flavor' on Instance uuid 552d8774-7d69-4ef5-b4e9-b0641e193beb {{(pid=115876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:44:00.519830 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-7329e533-9188-4f6e-9427-d8381e6650ab tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "POST /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb/action" status: 202 len: 0 microversion: 2.1 time: 0.110414 Oct 28 12:44:00.520587 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 530/1065] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:44:00 2021] POST /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:44:00.530805 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-a3b02607-45c4-4f7a-a6df-7ccfdf11b64f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:44:00.531496 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-a3b02607-45c4-4f7a-a6df-7ccfdf11b64f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:44:00.537798 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a3b02607-45c4-4f7a-a6df-7ccfdf11b64f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:00.538340 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a3b02607-45c4-4f7a-a6df-7ccfdf11b64f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:00.539118 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a3b02607-45c4-4f7a-a6df-7ccfdf11b64f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:00.539547 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a3b02607-45c4-4f7a-a6df-7ccfdf11b64f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:00.675675 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-a3b02607-45c4-4f7a-a6df-7ccfdf11b64f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:44:00.683381 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-a3b02607-45c4-4f7a-a6df-7ccfdf11b64f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1569 microversion: 2.1 time: 0.157871 Oct 28 12:44:00.683955 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 536/1066] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:44:00 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:44:01.706093 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-819fd74a-9a37-41c1-9434-9b6c352cb0f8 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:44:01.706761 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-819fd74a-9a37-41c1-9434-9b6c352cb0f8 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:44:01.713400 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-819fd74a-9a37-41c1-9434-9b6c352cb0f8 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:01.713837 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-819fd74a-9a37-41c1-9434-9b6c352cb0f8 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:01.714608 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-819fd74a-9a37-41c1-9434-9b6c352cb0f8 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:01.715030 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-819fd74a-9a37-41c1-9434-9b6c352cb0f8 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:01.847778 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-819fd74a-9a37-41c1-9434-9b6c352cb0f8 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:44:01.856363 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-819fd74a-9a37-41c1-9434-9b6c352cb0f8 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1569 microversion: 2.1 time: 0.155420 Oct 28 12:44:01.856997 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 531/1067] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:44:01 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:44:02.877447 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-b4f84730-3412-447c-a721-7d6c9b5be7a7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:44:02.878110 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-b4f84730-3412-447c-a721-7d6c9b5be7a7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:44:02.887170 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b4f84730-3412-447c-a721-7d6c9b5be7a7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:02.887814 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b4f84730-3412-447c-a721-7d6c9b5be7a7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:02.888847 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b4f84730-3412-447c-a721-7d6c9b5be7a7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:02.889556 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b4f84730-3412-447c-a721-7d6c9b5be7a7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:03.027971 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-b4f84730-3412-447c-a721-7d6c9b5be7a7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:44:03.035998 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-b4f84730-3412-447c-a721-7d6c9b5be7a7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1569 microversion: 2.1 time: 0.164881 Oct 28 12:44:03.036506 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 537/1068] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:44:02 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:44:04.056278 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-daf6a980-1388-4662-a6f0-c00ae45950ec tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:44:04.057057 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-daf6a980-1388-4662-a6f0-c00ae45950ec tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:44:04.063847 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-daf6a980-1388-4662-a6f0-c00ae45950ec tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:04.064447 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-daf6a980-1388-4662-a6f0-c00ae45950ec tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:04.065246 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-daf6a980-1388-4662-a6f0-c00ae45950ec tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:04.065679 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-daf6a980-1388-4662-a6f0-c00ae45950ec tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:04.209696 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-daf6a980-1388-4662-a6f0-c00ae45950ec tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:44:04.217425 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-daf6a980-1388-4662-a6f0-c00ae45950ec tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1569 microversion: 2.1 time: 0.165074 Oct 28 12:44:04.218483 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 532/1069] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:44:04 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:44:05.244270 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-b6fe81b9-6317-4787-a64d-1cf4a89ef9d7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:44:05.244994 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-b6fe81b9-6317-4787-a64d-1cf4a89ef9d7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:44:05.253000 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b6fe81b9-6317-4787-a64d-1cf4a89ef9d7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:05.253449 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b6fe81b9-6317-4787-a64d-1cf4a89ef9d7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:05.254222 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b6fe81b9-6317-4787-a64d-1cf4a89ef9d7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:05.254647 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b6fe81b9-6317-4787-a64d-1cf4a89ef9d7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:05.388381 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-b6fe81b9-6317-4787-a64d-1cf4a89ef9d7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:44:05.396220 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-b6fe81b9-6317-4787-a64d-1cf4a89ef9d7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1569 microversion: 2.1 time: 0.158172 Oct 28 12:44:05.396788 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 538/1070] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:44:05 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:44:06.416832 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-aa0f1303-4e75-45bb-8001-69fc5a03635f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:44:06.417431 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-aa0f1303-4e75-45bb-8001-69fc5a03635f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:44:06.424210 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-aa0f1303-4e75-45bb-8001-69fc5a03635f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:06.424845 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-aa0f1303-4e75-45bb-8001-69fc5a03635f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:06.425966 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-aa0f1303-4e75-45bb-8001-69fc5a03635f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:06.426384 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-aa0f1303-4e75-45bb-8001-69fc5a03635f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:06.555362 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-aa0f1303-4e75-45bb-8001-69fc5a03635f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:44:06.562815 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-aa0f1303-4e75-45bb-8001-69fc5a03635f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1569 microversion: 2.1 time: 0.150221 Oct 28 12:44:06.563384 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 533/1071] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:44:06 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:44:07.588895 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-d073b79d-8a50-40f9-ac6d-948e76f4ea6e tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:44:07.589868 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-d073b79d-8a50-40f9-ac6d-948e76f4ea6e tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:44:07.598296 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d073b79d-8a50-40f9-ac6d-948e76f4ea6e tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:07.598742 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d073b79d-8a50-40f9-ac6d-948e76f4ea6e tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:07.599523 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d073b79d-8a50-40f9-ac6d-948e76f4ea6e tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:07.599958 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-d073b79d-8a50-40f9-ac6d-948e76f4ea6e tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:07.724428 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-d073b79d-8a50-40f9-ac6d-948e76f4ea6e tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:44:07.732702 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-d073b79d-8a50-40f9-ac6d-948e76f4ea6e tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1569 microversion: 2.1 time: 0.150227 Oct 28 12:44:07.733298 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 539/1072] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:44:07 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:44:08.750553 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-9b49382a-4b22-47de-ad7f-9d1e31a82676 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:44:08.751250 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-9b49382a-4b22-47de-ad7f-9d1e31a82676 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:44:08.758736 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9b49382a-4b22-47de-ad7f-9d1e31a82676 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:08.759221 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9b49382a-4b22-47de-ad7f-9d1e31a82676 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:08.760058 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9b49382a-4b22-47de-ad7f-9d1e31a82676 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:08.760531 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-9b49382a-4b22-47de-ad7f-9d1e31a82676 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:08.893241 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-9b49382a-4b22-47de-ad7f-9d1e31a82676 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:44:08.901066 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-9b49382a-4b22-47de-ad7f-9d1e31a82676 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1569 microversion: 2.1 time: 0.154671 Oct 28 12:44:08.901601 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 534/1073] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:44:08 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:44:09.926098 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-0bf6aa2b-2540-4b90-b09b-661b054ba592 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:44:09.926866 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-0bf6aa2b-2540-4b90-b09b-661b054ba592 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:44:09.935569 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0bf6aa2b-2540-4b90-b09b-661b054ba592 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:09.936145 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0bf6aa2b-2540-4b90-b09b-661b054ba592 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:09.937246 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0bf6aa2b-2540-4b90-b09b-661b054ba592 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:09.937774 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-0bf6aa2b-2540-4b90-b09b-661b054ba592 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:10.072206 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-0bf6aa2b-2540-4b90-b09b-661b054ba592 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:44:10.081316 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-0bf6aa2b-2540-4b90-b09b-661b054ba592 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1569 microversion: 2.1 time: 0.161500 Oct 28 12:44:10.081917 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 540/1074] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:44:09 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:44:11.099415 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-dfc9b12a-ad7f-404a-ae78-c7e3535bdb8a tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:44:11.100023 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-dfc9b12a-ad7f-404a-ae78-c7e3535bdb8a tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:44:11.106878 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-dfc9b12a-ad7f-404a-ae78-c7e3535bdb8a tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:11.107298 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-dfc9b12a-ad7f-404a-ae78-c7e3535bdb8a tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:11.108060 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-dfc9b12a-ad7f-404a-ae78-c7e3535bdb8a tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:11.108482 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-dfc9b12a-ad7f-404a-ae78-c7e3535bdb8a tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:11.238277 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-dfc9b12a-ad7f-404a-ae78-c7e3535bdb8a tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:44:11.246139 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-dfc9b12a-ad7f-404a-ae78-c7e3535bdb8a tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1569 microversion: 2.1 time: 0.150383 Oct 28 12:44:11.246729 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 535/1075] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:44:11 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:44:12.267272 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-a349c8f0-3da6-4a13-88ae-82f1bd3696d7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:44:12.268343 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-a349c8f0-3da6-4a13-88ae-82f1bd3696d7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:44:12.278963 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a349c8f0-3da6-4a13-88ae-82f1bd3696d7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:12.279704 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a349c8f0-3da6-4a13-88ae-82f1bd3696d7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:12.281022 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a349c8f0-3da6-4a13-88ae-82f1bd3696d7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:12.281737 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-a349c8f0-3da6-4a13-88ae-82f1bd3696d7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:12.407841 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-a349c8f0-3da6-4a13-88ae-82f1bd3696d7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:44:12.415360 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-a349c8f0-3da6-4a13-88ae-82f1bd3696d7 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1569 microversion: 2.1 time: 0.154312 Oct 28 12:44:12.415931 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 541/1076] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:44:12 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:44:13.432462 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-adb9cb74-3e6a-4d08-980a-e8a7f88eb18f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:44:13.433078 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-adb9cb74-3e6a-4d08-980a-e8a7f88eb18f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:44:13.439129 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-adb9cb74-3e6a-4d08-980a-e8a7f88eb18f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:13.439544 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-adb9cb74-3e6a-4d08-980a-e8a7f88eb18f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:13.440376 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-adb9cb74-3e6a-4d08-980a-e8a7f88eb18f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:13.440839 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-adb9cb74-3e6a-4d08-980a-e8a7f88eb18f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:13.564238 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-adb9cb74-3e6a-4d08-980a-e8a7f88eb18f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:44:13.572592 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-adb9cb74-3e6a-4d08-980a-e8a7f88eb18f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1569 microversion: 2.1 time: 0.143806 Oct 28 12:44:13.573193 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 536/1077] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:44:13 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1569 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:44:14.593344 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-7479889a-4570-4def-86a9-f4b8af82567b tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:44:14.594002 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-7479889a-4570-4def-86a9-f4b8af82567b tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:44:14.601806 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7479889a-4570-4def-86a9-f4b8af82567b tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:14.602250 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7479889a-4570-4def-86a9-f4b8af82567b tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:14.603023 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7479889a-4570-4def-86a9-f4b8af82567b tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:14.603447 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7479889a-4570-4def-86a9-f4b8af82567b tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:14.737992 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-7479889a-4570-4def-86a9-f4b8af82567b tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:44:14.746323 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-7479889a-4570-4def-86a9-f4b8af82567b tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1510 microversion: 2.1 time: 0.159351 Oct 28 12:44:14.746866 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 542/1078] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:44:14 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:44:14.762976 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-12d36d0b-7e78-42b9-a155-8e84b2cf846c tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:44:14.763534 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-12d36d0b-7e78-42b9-a155-8e84b2cf846c tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:44:14.770345 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-12d36d0b-7e78-42b9-a155-8e84b2cf846c tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:14.770771 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-12d36d0b-7e78-42b9-a155-8e84b2cf846c tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:14.771531 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-12d36d0b-7e78-42b9-a155-8e84b2cf846c tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:14.771956 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-12d36d0b-7e78-42b9-a155-8e84b2cf846c tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:14.851661 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-12d36d0b-7e78-42b9-a155-8e84b2cf846c tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "POST /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb/action" status: 202 len: 0 microversion: 2.1 time: 0.092371 Oct 28 12:44:14.852165 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 537/1079] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Oct 28 12:44:14 2021] POST /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:44:14.863959 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-368a4b41-a012-4fde-87e4-8f0907ae7306 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:44:14.864654 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-368a4b41-a012-4fde-87e4-8f0907ae7306 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:44:14.878185 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-368a4b41-a012-4fde-87e4-8f0907ae7306 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:14.878502 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-368a4b41-a012-4fde-87e4-8f0907ae7306 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:14.879367 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-368a4b41-a012-4fde-87e4-8f0907ae7306 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:14.879852 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-368a4b41-a012-4fde-87e4-8f0907ae7306 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:15.011288 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-368a4b41-a012-4fde-87e4-8f0907ae7306 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:44:15.019209 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-368a4b41-a012-4fde-87e4-8f0907ae7306 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1518 microversion: 2.1 time: 0.160901 Oct 28 12:44:15.020001 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 543/1080] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:44:14 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:44:15.334359 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 12:44:15.334583 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: Thu Oct 28 12:44:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 12:44:16.036073 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-042b4501-8c7c-4ba5-8981-34f3851bfd57 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:44:16.037307 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-042b4501-8c7c-4ba5-8981-34f3851bfd57 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:44:16.043471 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-042b4501-8c7c-4ba5-8981-34f3851bfd57 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:16.043996 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-042b4501-8c7c-4ba5-8981-34f3851bfd57 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:16.044890 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-042b4501-8c7c-4ba5-8981-34f3851bfd57 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:16.045381 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-042b4501-8c7c-4ba5-8981-34f3851bfd57 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:16.086093 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-610bd392-5ca9-40d0-98e5-0fdf81a2fa81 req-8d59fdbb-151c-483d-ba1d-56ba22ee4e59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "552d8774-7d69-4ef5-b4e9-b0641e193beb", "name": "network-vif-unplugged", "status": "completed", "tag": "988ed513-b45c-4553-99bb-415e6179c274"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:44:16.088326 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:44:16.088326 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:44:16.096700 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-610bd392-5ca9-40d0-98e5-0fdf81a2fa81 req-8d59fdbb-151c-483d-ba1d-56ba22ee4e59 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:16.097186 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-610bd392-5ca9-40d0-98e5-0fdf81a2fa81 req-8d59fdbb-151c-483d-ba1d-56ba22ee4e59 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:16.115956 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-610bd392-5ca9-40d0-98e5-0fdf81a2fa81 req-8d59fdbb-151c-483d-ba1d-56ba22ee4e59 service nova] Creating event network-vif-unplugged:988ed513-b45c-4553-99bb-415e6179c274 for instance 552d8774-7d69-4ef5-b4e9-b0641e193beb on hv-cinder-81514 Oct 28 12:44:16.121519 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-610bd392-5ca9-40d0-98e5-0fdf81a2fa81 req-8d59fdbb-151c-483d-ba1d-56ba22ee4e59 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039289 Oct 28 12:44:16.122400 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 544/1081] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:44:16 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:44:16.183457 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-042b4501-8c7c-4ba5-8981-34f3851bfd57 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:44:16.190862 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-042b4501-8c7c-4ba5-8981-34f3851bfd57 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1576 microversion: 2.1 time: 0.159212 Oct 28 12:44:16.191429 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 538/1082] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:44:16 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:44:16.914090 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 12:44:16.914328 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: Thu Oct 28 12:44:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 12:44:17.208804 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-efbab4fc-acdc-4fd9-b911-62858236cd85 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:44:17.209509 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-efbab4fc-acdc-4fd9-b911-62858236cd85 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:44:17.216491 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-efbab4fc-acdc-4fd9-b911-62858236cd85 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:17.216957 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-efbab4fc-acdc-4fd9-b911-62858236cd85 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:17.217710 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-efbab4fc-acdc-4fd9-b911-62858236cd85 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:17.218134 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-efbab4fc-acdc-4fd9-b911-62858236cd85 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:17.360375 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-efbab4fc-acdc-4fd9-b911-62858236cd85 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:44:17.368560 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-efbab4fc-acdc-4fd9-b911-62858236cd85 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1576 microversion: 2.1 time: 0.164018 Oct 28 12:44:17.369154 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 545/1083] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:44:17 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:44:18.389651 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-30d72bf1-db7d-4011-8f77-8a1525bc943b tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:44:18.390545 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-30d72bf1-db7d-4011-8f77-8a1525bc943b tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:44:18.401991 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-30d72bf1-db7d-4011-8f77-8a1525bc943b tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:18.402711 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-30d72bf1-db7d-4011-8f77-8a1525bc943b tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:18.403962 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-30d72bf1-db7d-4011-8f77-8a1525bc943b tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:18.404647 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-30d72bf1-db7d-4011-8f77-8a1525bc943b tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:18.549238 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-30d72bf1-db7d-4011-8f77-8a1525bc943b tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:44:18.557559 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-30d72bf1-db7d-4011-8f77-8a1525bc943b tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1576 microversion: 2.1 time: 0.174168 Oct 28 12:44:18.558123 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 539/1084] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:44:18 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:44:19.578415 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-7381f3bd-1bd5-4317-8ee0-e0be9426c883 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:44:19.579407 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-7381f3bd-1bd5-4317-8ee0-e0be9426c883 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:44:19.590039 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7381f3bd-1bd5-4317-8ee0-e0be9426c883 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:19.590788 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7381f3bd-1bd5-4317-8ee0-e0be9426c883 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:19.592052 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7381f3bd-1bd5-4317-8ee0-e0be9426c883 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:19.592791 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-7381f3bd-1bd5-4317-8ee0-e0be9426c883 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:19.735697 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-7381f3bd-1bd5-4317-8ee0-e0be9426c883 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:44:19.746498 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-7381f3bd-1bd5-4317-8ee0-e0be9426c883 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1576 microversion: 2.1 time: 0.173960 Oct 28 12:44:19.747271 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 546/1085] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:44:19 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:44:20.768775 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-1a11356e-4473-4e8f-8458-00218345ca44 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:44:20.769421 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-1a11356e-4473-4e8f-8458-00218345ca44 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:44:20.776070 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1a11356e-4473-4e8f-8458-00218345ca44 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:20.776500 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1a11356e-4473-4e8f-8458-00218345ca44 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:20.777277 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1a11356e-4473-4e8f-8458-00218345ca44 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:20.777694 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-1a11356e-4473-4e8f-8458-00218345ca44 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:20.911344 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-1a11356e-4473-4e8f-8458-00218345ca44 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:44:20.919298 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-1a11356e-4473-4e8f-8458-00218345ca44 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1576 microversion: 2.1 time: 0.156574 Oct 28 12:44:20.919863 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 540/1086] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:44:20 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:44:21.940305 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-4966dfe9-14bc-43d3-8142-9e643c754a9d tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:44:21.941046 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-4966dfe9-14bc-43d3-8142-9e643c754a9d tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:44:21.948634 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4966dfe9-14bc-43d3-8142-9e643c754a9d tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:21.949147 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4966dfe9-14bc-43d3-8142-9e643c754a9d tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:21.949940 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4966dfe9-14bc-43d3-8142-9e643c754a9d tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:21.950405 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-4966dfe9-14bc-43d3-8142-9e643c754a9d tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:22.079533 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-4966dfe9-14bc-43d3-8142-9e643c754a9d tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:44:22.087401 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-4966dfe9-14bc-43d3-8142-9e643c754a9d tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1576 microversion: 2.1 time: 0.153103 Oct 28 12:44:22.087970 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 547/1087] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:44:21 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:44:23.108598 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-2c77de3a-eeef-4e59-9769-1ff308f36afe tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:44:23.109494 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-2c77de3a-eeef-4e59-9769-1ff308f36afe tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:44:23.118013 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2c77de3a-eeef-4e59-9769-1ff308f36afe tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:23.118452 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2c77de3a-eeef-4e59-9769-1ff308f36afe tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:23.119209 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2c77de3a-eeef-4e59-9769-1ff308f36afe tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:23.119631 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2c77de3a-eeef-4e59-9769-1ff308f36afe tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:23.256307 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-2c77de3a-eeef-4e59-9769-1ff308f36afe tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:44:23.266314 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-2c77de3a-eeef-4e59-9769-1ff308f36afe tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1576 microversion: 2.1 time: 0.163643 Oct 28 12:44:23.267007 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 541/1088] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:44:23 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:44:24.289440 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-b6e14d15-2837-4e90-b204-878afdc0c33a tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:44:24.290069 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-b6e14d15-2837-4e90-b204-878afdc0c33a tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:44:24.296640 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b6e14d15-2837-4e90-b204-878afdc0c33a tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:24.297118 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b6e14d15-2837-4e90-b204-878afdc0c33a tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:24.297879 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b6e14d15-2837-4e90-b204-878afdc0c33a tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:24.298302 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b6e14d15-2837-4e90-b204-878afdc0c33a tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:24.439544 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-b6e14d15-2837-4e90-b204-878afdc0c33a tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:44:24.447278 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-b6e14d15-2837-4e90-b204-878afdc0c33a tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1576 microversion: 2.1 time: 0.163147 Oct 28 12:44:24.447911 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 548/1089] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:44:24 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:44:25.468216 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-ac9d7fbc-6675-4ab4-bd2e-a179e04940c1 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:44:25.469141 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-ac9d7fbc-6675-4ab4-bd2e-a179e04940c1 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:44:25.477894 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ac9d7fbc-6675-4ab4-bd2e-a179e04940c1 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:25.478339 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ac9d7fbc-6675-4ab4-bd2e-a179e04940c1 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:25.479098 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ac9d7fbc-6675-4ab4-bd2e-a179e04940c1 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:25.479523 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-ac9d7fbc-6675-4ab4-bd2e-a179e04940c1 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:25.618661 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-ac9d7fbc-6675-4ab4-bd2e-a179e04940c1 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:44:25.631118 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-ac9d7fbc-6675-4ab4-bd2e-a179e04940c1 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1576 microversion: 2.1 time: 0.168795 Oct 28 12:44:25.631634 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 542/1090] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:44:25 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:44:26.207144 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-ede831a8-6114-4f4c-af88-f67cddd039ab req-222eaf57-9db1-45bd-9609-26bd797266bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "552d8774-7d69-4ef5-b4e9-b0641e193beb", "name": "network-vif-plugged", "status": "completed", "tag": "988ed513-b45c-4553-99bb-415e6179c274"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:44:26.208664 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:44:26.208664 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:44:26.216271 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-ede831a8-6114-4f4c-af88-f67cddd039ab req-222eaf57-9db1-45bd-9609-26bd797266bd service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:26.216702 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-ede831a8-6114-4f4c-af88-f67cddd039ab req-222eaf57-9db1-45bd-9609-26bd797266bd service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:26.227935 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-ede831a8-6114-4f4c-af88-f67cddd039ab req-222eaf57-9db1-45bd-9609-26bd797266bd service nova] Creating event network-vif-plugged:988ed513-b45c-4553-99bb-415e6179c274 for instance 552d8774-7d69-4ef5-b4e9-b0641e193beb on hv-cinder-81514 Oct 28 12:44:26.232923 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-ede831a8-6114-4f4c-af88-f67cddd039ab req-222eaf57-9db1-45bd-9609-26bd797266bd service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029451 Oct 28 12:44:26.233540 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 549/1091] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:44:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:44:26.650122 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-2d0ce27f-d172-49a9-9b8f-755ae416692b tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:44:26.650737 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-2d0ce27f-d172-49a9-9b8f-755ae416692b tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:44:26.657644 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2d0ce27f-d172-49a9-9b8f-755ae416692b tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:26.658081 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2d0ce27f-d172-49a9-9b8f-755ae416692b tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:26.658843 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2d0ce27f-d172-49a9-9b8f-755ae416692b tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:26.659266 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-2d0ce27f-d172-49a9-9b8f-755ae416692b tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:26.792386 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-2d0ce27f-d172-49a9-9b8f-755ae416692b tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:44:26.803817 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-2d0ce27f-d172-49a9-9b8f-755ae416692b tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1576 microversion: 2.1 time: 0.157939 Oct 28 12:44:26.804405 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 543/1092] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:44:26 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:44:27.822685 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-b5c9d3aa-8c45-4e02-ac5f-0efef7d6d0e4 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:44:27.823372 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-b5c9d3aa-8c45-4e02-ac5f-0efef7d6d0e4 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:44:27.829778 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b5c9d3aa-8c45-4e02-ac5f-0efef7d6d0e4 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:27.830527 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b5c9d3aa-8c45-4e02-ac5f-0efef7d6d0e4 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:27.831121 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b5c9d3aa-8c45-4e02-ac5f-0efef7d6d0e4 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:44:27.831555 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-b5c9d3aa-8c45-4e02-ac5f-0efef7d6d0e4 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:44:27.967719 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-b5c9d3aa-8c45-4e02-ac5f-0efef7d6d0e4 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:44:27.975742 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-b5c9d3aa-8c45-4e02-ac5f-0efef7d6d0e4 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1563 microversion: 2.1 time: 0.157697 Oct 28 12:44:27.976310 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 550/1093] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:44:27 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:45:38.857029 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f32e3d1b-214a-41ce-9b54-df23bf7772e9] AMQP server on 10.222.0.62:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 12:45:38.857701 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-439754c0-3820-41f4-8020-2542aa73406f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:45:38.857701 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-439754c0-3820-41f4-8020-2542aa73406f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:45:38.862449 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-c7a63a08-48eb-4bd2-acb8-e11e5fbd1791 req-50253b3f-4282-4e8b-a502-1fa194dadb35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "552d8774-7d69-4ef5-b4e9-b0641e193beb", "tag": "988ed513-b45c-4553-99bb-415e6179c274"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:45:38.863814 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-439754c0-3820-41f4-8020-2542aa73406f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:45:38.864251 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-439754c0-3820-41f4-8020-2542aa73406f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:45:38.864408 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:45:38.864408 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:45:38.865054 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-439754c0-3820-41f4-8020-2542aa73406f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:45:38.865472 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-439754c0-3820-41f4-8020-2542aa73406f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:45:38.871465 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-c7a63a08-48eb-4bd2-acb8-e11e5fbd1791 req-50253b3f-4282-4e8b-a502-1fa194dadb35 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:45:38.871901 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-c7a63a08-48eb-4bd2-acb8-e11e5fbd1791 req-50253b3f-4282-4e8b-a502-1fa194dadb35 service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:45:38.883064 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-c7a63a08-48eb-4bd2-acb8-e11e5fbd1791 req-50253b3f-4282-4e8b-a502-1fa194dadb35 service nova] Creating event network-changed:988ed513-b45c-4553-99bb-415e6179c274 for instance 552d8774-7d69-4ef5-b4e9-b0641e193beb on hv-cinder-81514 Oct 28 12:45:38.888579 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-c7a63a08-48eb-4bd2-acb8-e11e5fbd1791 req-50253b3f-4282-4e8b-a502-1fa194dadb35 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033201 Oct 28 12:45:38.889202 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 551/1094] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:45:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:45:38.900612 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-439754c0-3820-41f4-8020-2542aa73406f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Going to try to terminate instance {{(pid=115876) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:45:38.984182 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-439754c0-3820-41f4-8020-2542aa73406f tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "DELETE /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 204 len: 0 microversion: 2.1 time: 0.131851 Oct 28 12:45:38.987339 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 544/1095] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Oct 28 12:45:38 2021] DELETE /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:45:38.994976 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-324473f8-c75e-40cf-9fd3-3f701d00b343 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:45:38.995947 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-324473f8-c75e-40cf-9fd3-3f701d00b343 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:45:39.003145 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-324473f8-c75e-40cf-9fd3-3f701d00b343 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:45:39.003588 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-324473f8-c75e-40cf-9fd3-3f701d00b343 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:45:39.004364 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-324473f8-c75e-40cf-9fd3-3f701d00b343 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:45:39.004856 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-324473f8-c75e-40cf-9fd3-3f701d00b343 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:45:39.139012 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.policy [None req-324473f8-c75e-40cf-9fd3-3f701d00b343 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:45:39.147210 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-324473f8-c75e-40cf-9fd3-3f701d00b343 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1569 microversion: 2.1 time: 0.156461 Oct 28 12:45:39.149469 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 552/1096] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:45:38 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:45:40.166643 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-3f51a6a8-2db9-4c14-8354-73fd1e3b92c0 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:45:40.167366 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-3f51a6a8-2db9-4c14-8354-73fd1e3b92c0 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:45:40.174232 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3f51a6a8-2db9-4c14-8354-73fd1e3b92c0 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:45:40.174678 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3f51a6a8-2db9-4c14-8354-73fd1e3b92c0 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:45:40.175446 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3f51a6a8-2db9-4c14-8354-73fd1e3b92c0 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:45:40.175874 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-3f51a6a8-2db9-4c14-8354-73fd1e3b92c0 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:45:40.300960 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-3f51a6a8-2db9-4c14-8354-73fd1e3b92c0 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:45:40.309377 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-3f51a6a8-2db9-4c14-8354-73fd1e3b92c0 tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1450 microversion: 2.1 time: 0.146999 Oct 28 12:45:40.309949 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 545/1097] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:45:40 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1450 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:45:41.021484 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO oslo.messaging._drivers.impl_rabbit [-] [f32e3d1b-214a-41ce-9b54-df23bf7772e9] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 56272. Oct 28 12:45:41.099406 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [req-24d6b954-6ae7-40de-8c64-137ec4a336b4 req-90c7df9e-68bd-47da-ad72-86605b3cffec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "552d8774-7d69-4ef5-b4e9-b0641e193beb", "name": "network-vif-deleted", "tag": "988ed513-b45c-4553-99bb-415e6179c274"}]} {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:45:41.101089 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:45:41.101089 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: warnings.warn(msg) Oct 28 12:45:41.107899 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-24d6b954-6ae7-40de-8c64-137ec4a336b4 req-90c7df9e-68bd-47da-ad72-86605b3cffec service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:45:41.108327 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [req-24d6b954-6ae7-40de-8c64-137ec4a336b4 req-90c7df9e-68bd-47da-ad72-86605b3cffec service nova] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:45:41.118748 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.compute.server_external_events [req-24d6b954-6ae7-40de-8c64-137ec4a336b4 req-90c7df9e-68bd-47da-ad72-86605b3cffec service nova] Creating event network-vif-deleted:988ed513-b45c-4553-99bb-415e6179c274 for instance 552d8774-7d69-4ef5-b4e9-b0641e193beb on hv-cinder-81514 Oct 28 12:45:41.123702 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [req-24d6b954-6ae7-40de-8c64-137ec4a336b4 req-90c7df9e-68bd-47da-ad72-86605b3cffec service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132910 Oct 28 12:45:41.124404 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 553/1098] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Oct 28 12:45:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:45:41.327585 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-fa2493b0-fa84-4c25-8574-7fa1db86128a tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:45:41.328877 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.compute.api [None req-fa2493b0-fa84-4c25-8574-7fa1db86128a tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115876) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:45:41.336204 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fa2493b0-fa84-4c25-8574-7fa1db86128a tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:45:41.337005 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fa2493b0-fa84-4c25-8574-7fa1db86128a tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:45:41.337997 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fa2493b0-fa84-4c25-8574-7fa1db86128a tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:45:41.338430 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG oslo_concurrency.lockutils [None req-fa2493b0-fa84-4c25-8574-7fa1db86128a tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:45:41.408523 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.policy [None req-fa2493b0-fa84-4c25-8574-7fa1db86128a tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8e5f1cbf384f1895492671dd613299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60093ead9d64a9894ae4caafeaf039b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115876) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:45:41.423082 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-fa2493b0-fa84-4c25-8574-7fa1db86128a tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 200 len: 1220 microversion: 2.1 time: 0.100011 Oct 28 12:45:41.423808 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 546/1099] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:45:41 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 1220 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:45:42.441711 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-e2898101-6bbd-4982-a941-09931996b9ee tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '>' {{(pid=115877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:45:42.442362 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.compute.api [None req-e2898101-6bbd-4982-a941-09931996b9ee tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] [instance: 552d8774-7d69-4ef5-b4e9-b0641e193beb] Fetching instance by UUID {{(pid=115877) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:45:42.450004 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e2898101-6bbd-4982-a941-09931996b9ee tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:45:42.450458 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e2898101-6bbd-4982-a941-09931996b9ee tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:45:42.451234 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e2898101-6bbd-4982-a941-09931996b9ee tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:45:42.451669 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG oslo_concurrency.lockutils [None req-e2898101-6bbd-4982-a941-09931996b9ee tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Lock "b82f072f-c7c2-44f1-a3e5-64a44a75f91b" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:45:42.465133 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.wsgi [None req-e2898101-6bbd-4982-a941-09931996b9ee tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] HTTP exception thrown: Instance 552d8774-7d69-4ef5-b4e9-b0641e193beb could not be found. Oct 28 12:45:42.465727 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: DEBUG nova.api.openstack.wsgi [None req-e2898101-6bbd-4982-a941-09931996b9ee tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Returning 404 to user: Instance 552d8774-7d69-4ef5-b4e9-b0641e193beb could not be found. {{(pid=115877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:45:42.466549 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO nova.api.openstack.requestlog [None req-e2898101-6bbd-4982-a941-09931996b9ee tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb" status: 404 len: 111 microversion: 2.1 time: 0.030061 Oct 28 12:45:42.467085 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: [pid: 115877|app: 0|req: 554/1100] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Oct 28 12:45:42 2021] GET /compute/v2.1/servers/552d8774-7d69-4ef5-b4e9-b0641e193beb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:45:42.645205 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: DEBUG nova.api.openstack.wsgi [None req-41feba42-37c6-4287-9535-74525613275d tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] Calling method '.version_select at 0x7f4a792ef700>' {{(pid=115876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:45:42.672497 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO nova.api.openstack.requestlog [None req-41feba42-37c6-4287-9535-74525613275d tempest-TestShelveInstance-267614621 tempest-TestShelveInstance-267614621-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1478594294" status: 202 len: 0 microversion: 2.1 time: 0.032156 Oct 28 12:45:42.673376 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: [pid: 115876|app: 0|req: 547/1101] 10.222.0.62 () {58 vars in 1253 bytes} [Thu Oct 28 12:45:42 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1478594294 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:46:59.225180 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 12:46:59.225757 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: Thu Oct 28 12:46:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 12:47:17.326220 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 12:47:17.327119 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: Thu Oct 28 12:47:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 12:47:35.354665 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 12:47:35.355303 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: Thu Oct 28 12:47:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 12:50:19.246781 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 12:50:19.247781 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: Thu Oct 28 12:50:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 12:50:37.351892 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 12:50:37.352551 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: Thu Oct 28 12:50:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 12:50:52.574721 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 12:50:52.575847 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: Thu Oct 28 12:50:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 12:50:55.373789 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 12:50:55.374744 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: Thu Oct 28 12:50:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 12:50:56.942239 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 12:50:56.943158 dv-cinder-815146-6-iscsi devstack@n-api.service[115876]: Thu Oct 28 12:50:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 12:51:01.113689 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 12:51:01.114606 dv-cinder-815146-6-iscsi devstack@n-api.service[115877]: Thu Oct 28 12:51:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!